-- Logs begin at Tue 2022-08-23 21:18:52 UTC, end at Tue 2022-08-23 23:25:30 UTC. -- Aug 23 22:22:00.971816 dv-cinder-842542-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 22:22:00.981792 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:22:00 2022] *** Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: nodename: dv-cinder-842542-4-iscsi Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: machine: x86_64 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: clock source: unix Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: pcre jit disabled Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: detected number of CPU cores: 4 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: current working directory: / Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: your processes number limit is 47680 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: your memory page size is 4096 bytes Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: detected max file descriptor number: 2048 Aug 23 22:22:00.983890 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: lock engine: pthread robust mutexes Aug 23 22:22:00.985447 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: thunder lock: enabled Aug 23 22:22:00.985447 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 22:22:00.985447 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:22:01.026568 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: Python main interpreter initialized at 0x55f09ed5f9c0 Aug 23 22:22:01.026568 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: python threads support enabled Aug 23 22:22:01.026568 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: your server socket listen backlog is limited to 100 connections Aug 23 22:22:01.026568 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:22:01.027006 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:22:01.027006 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: *** Operational MODE: preforking *** Aug 23 22:22:01.027307 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:22:01.027307 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: spawned uWSGI master process (pid: 105984) Aug 23 22:22:01.027521 dv-cinder-842542-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 22:22:01.028125 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: spawned uWSGI worker 1 (pid: 105985, cores: 1) Aug 23 22:22:01.028468 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: spawned uWSGI worker 2 (pid: 105986, cores: 1) Aug 23 22:22:01.028617 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:22:01.726158 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:22:01.731636 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:22:02.842913 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:22:02.842913 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: from cryptography.utils import int_from_bytes Aug 23 22:22:02.843595 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:22:02.843595 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: from cryptography.utils import int_from_bytes Aug 23 22:22:02.845451 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:22:02.845451 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: from cryptography.utils import int_from_bytes Aug 23 22:22:02.845912 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:22:02.845912 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: from cryptography.utils import int_from_bytes Aug 23 22:22:05.390727 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:22:05.391351 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:22:05.391568 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:22:05.391869 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:22:05.392129 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:22:05.392520 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.392849 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.393218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.393541 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.393873 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.394186 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.394509 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.394835 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.395160 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.395278 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:22:05.395634 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.395721 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:22:05.395808 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.396026 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:22:05.396130 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-4-iscsi {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.396345 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.396441 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:22:05.396631 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:22:05.396723 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.396951 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397113 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397299 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397431 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397612 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397756 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.397932 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.398037 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.398239 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.398343 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.398629 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.398767 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.399154 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.399287 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.399500 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.399730 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.399819 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400115 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400243 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400423 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400737 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.400837 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.401086 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.401217 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-4-iscsi {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.401393 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.401701 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.401701 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.402192 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.402445 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.402646 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.402880 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.403087 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-4-iscsi {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.403321 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.403531 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.403750 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.403948 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.404156 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.404367 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.404580 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.404805 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405033 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405262 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405443 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405638 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405813 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.405970 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406113 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406288 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406288 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406566 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406566 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406827 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.406998 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407141 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407296 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407439 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407439 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407721 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.407869 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408012 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408154 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408330 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-4-iscsi {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408484 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408624 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408759 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.408913 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409074 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409223 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409366 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409366 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409640 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.409780 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410016 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410166 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410314 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410455 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410589 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410729 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.410867 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411083 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411224 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411365 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411545 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411796 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.411941 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412164 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412308 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412450 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412583 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412717 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.412863 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413004 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413199 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413334 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413488 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413628 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413771 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.413912 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.414053 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.414193 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.414833 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.414975 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415121 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415266 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415408 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415542 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415682 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415827 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.415972 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416107 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416239 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416383 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416526 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416669 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416804 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.416940 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417096 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417242 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417394 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417539 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417685 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417831 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.417966 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418113 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418263 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418542 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418685 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418826 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.418961 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419108 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419257 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419398 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419533 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419665 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419805 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.419952 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420194 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420346 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420482 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420615 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420748 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.420894 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421110 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421252 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421387 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421387 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421650 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421650 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.421941 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422074 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422348 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422499 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422499 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422753 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.422903 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423036 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423322 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423461 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423595 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423730 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423863 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.423997 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424143 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424277 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424460 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424599 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424750 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.424894 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425062 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425204 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425343 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425484 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425624 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425767 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.425901 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426034 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426167 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426306 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426446 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426605 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426747 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.426894 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427028 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427161 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427300 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427447 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427589 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427723 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.427864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428137 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428289 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428444 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428584 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428717 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428850 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428990 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.428990 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429313 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429448 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429580 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429713 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429846 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.429988 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.430807 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.430952 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431093 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431229 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431229 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431500 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431633 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431772 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.431905 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432039 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432191 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432328 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432463 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432619 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432753 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.432893 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433067 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433265 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433578 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433724 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.433897 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434048 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434205 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434346 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434512 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434674 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434816 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.434960 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435095 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435230 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435550 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435746 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.435899 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.436035 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.436169 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.436340 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.436482 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.436658 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.436802 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.436964 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.437161 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.437308 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.437450 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.437601 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.437736 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.437877 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.438011 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.438153 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.438305 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.438528 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.438665 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.438806 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.438941 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.439073 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.439219 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.439355 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.439488 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.439628 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.439762 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.439923 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.440081 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.440298 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.440452 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.440607 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.440749 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.440981 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.441173 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.441316 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:22:05.441460 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.441594 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.441727 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.441871 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442014 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442211 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442353 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442526 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442678 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442821 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.442954 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443159 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443320 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443478 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443621 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443790 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.443947 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444083 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444413 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444558 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444723 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.444870 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445076 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445352 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445486 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445664 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.445845 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.446179 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.446323 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.446508 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.446685 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.446842 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447014 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447157 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447333 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447476 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447654 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447807 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.447967 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448110 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448284 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448427 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448617 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448785 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.448925 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449086 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449264 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449595 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449744 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.449915 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450058 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450227 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450369 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450539 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450700 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.450843 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451002 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451217 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451364 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451512 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451653 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451788 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.451923 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452064 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452210 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452346 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452480 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452624 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452759 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.452925 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453129 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453269 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453404 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453582 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453726 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.453889 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454046 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454189 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454323 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454496 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454657 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454792 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.454934 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455095 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455238 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455556 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455719 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.455870 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456026 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456170 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456331 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456473 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456626 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456771 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.456934 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457251 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457386 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457552 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457702 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.457870 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458011 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458187 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458329 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458479 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458625 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458798 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.458939 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459255 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459403 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459537 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459728 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.459872 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460032 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460188 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460331 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460485 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460626 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460760 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.460925 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.461708 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.461932 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462080 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462216 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462357 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462493 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462793 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.462937 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463102 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463261 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463396 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463532 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463709 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463853 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.463997 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464138 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464307 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464464 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464609 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464743 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.464910 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465102 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465255 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465399 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465536 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465671 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465805 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.465946 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466273 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466439 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466583 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466751 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.466894 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467062 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467220 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467362 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467502 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467658 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.467801 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468004 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468147 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468305 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468446 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468644 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468789 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.468977 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469191 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469335 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469480 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469628 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469765 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.469911 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470054 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470195 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470330 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470464 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470605 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470770 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.470915 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471081 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471225 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471386 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471539 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471675 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.471816 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472311 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472459 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472593 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472734 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.472869 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473042 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473245 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473398 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473554 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473705 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473840 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.473980 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474149 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474300 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474487 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474704 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474845 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.474981 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475135 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475271 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475430 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475572 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475743 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.475895 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476045 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476181 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476356 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476497 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476671 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.476848 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.477684 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.477832 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478024 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478236 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478482 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478620 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478770 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.478905 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479040 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479228 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479371 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479544 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479700 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479854 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.479998 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480169 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480311 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480459 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480601 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480775 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.480917 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481130 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481275 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481440 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481594 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481758 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.481918 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.482620 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.482770 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.482918 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483055 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483190 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483478 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483614 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483758 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.483893 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484049 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484202 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484355 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484535 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484678 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484819 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.484962 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485144 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485293 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485437 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485625 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485767 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.485910 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486066 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486215 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486370 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486507 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486666 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486801 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.486935 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487070 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487218 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487354 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487488 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487624 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487759 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.487909 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488097 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488292 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488433 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488575 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488735 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.488884 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489047 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489202 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489338 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489480 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489621 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489766 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.489918 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490065 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490207 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490349 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490505 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490651 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490787 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.490929 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491063 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491211 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491446 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491634 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491806 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.491961 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.492109 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.492270 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.492448 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.492707 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.492917 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493111 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493254 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493389 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493534 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493671 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493671 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.493924 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494059 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494205 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494350 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494485 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494624 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494767 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.494902 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495036 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495180 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495315 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495450 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495584 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495717 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.495883 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496039 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496174 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496309 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496309 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496571 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496718 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496854 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.496990 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497148 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497283 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497416 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497416 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497693 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497829 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.497964 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498099 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498233 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498381 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498553 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498706 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.498878 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499029 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499185 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499335 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499515 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499675 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499842 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.499992 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500147 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500289 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500440 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500591 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500733 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.500874 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501062 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501228 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501378 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501520 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501681 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501823 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.501964 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.502114 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.502265 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.502407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.502911 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503053 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503189 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503470 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503614 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503761 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.503905 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504049 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504185 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504320 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504591 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504725 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.504868 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505182 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505378 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505520 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505654 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505811 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.505957 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506093 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506237 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506382 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506518 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506653 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506801 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.506960 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507103 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507304 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507447 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507593 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507741 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.507937 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508206 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508359 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508515 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508667 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508819 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.508963 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.509248 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.509398 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.509576 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.509726 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.509896 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510039 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510182 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510484 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510634 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510785 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.510927 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511068 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511210 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511358 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511500 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511650 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511815 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.511957 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512105 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512247 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512389 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512539 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512681 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.512823 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513135 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513296 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513447 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513598 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513740 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.513901 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514042 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514191 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514346 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514488 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514636 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514778 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.514919 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515061 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515284 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515429 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515570 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515712 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.515864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516021 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516164 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516306 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516447 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516588 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516728 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.516878 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517050 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517200 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517341 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517482 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517644 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517795 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.517937 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518080 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518228 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518377 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518526 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518677 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518830 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.518979 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519121 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519262 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519411 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519562 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519703 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519844 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.519984 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520125 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520289 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520433 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520580 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520722 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.520862 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521004 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521187 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521342 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521497 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521647 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521789 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.521937 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522088 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522237 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522390 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522532 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522673 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522822 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.522971 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.523136 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.523358 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.523517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.523659 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.524380 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.524579 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.524736 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.524736 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525122 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525278 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525434 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525584 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525584 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525852 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.525994 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526153 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526304 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526453 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526596 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526736 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.526736 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527026 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527169 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527310 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527452 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527598 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527748 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.527912 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528055 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528197 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528338 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528480 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528621 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528770 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.528912 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529078 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529238 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529380 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529521 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529676 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529828 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.529970 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530111 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530259 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530400 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530550 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530698 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530849 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.530997 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531146 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531296 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531437 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531585 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531736 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.531885 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532033 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532188 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532329 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532471 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532611 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532752 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.532893 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533066 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533215 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533372 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533595 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533761 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.533904 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534054 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534196 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534337 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534484 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534625 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534781 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.534923 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535065 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535206 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535348 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535498 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535658 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535807 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.535949 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536091 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536239 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536388 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536539 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536682 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536823 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.536964 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537159 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537302 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537465 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537608 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537757 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.537899 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538047 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538198 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538347 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538489 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538632 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538773 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.538922 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.539073 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.539216 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540261 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540412 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540412 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540682 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540833 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.540975 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541138 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541255 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541345 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541532 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541613 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541827 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.541917 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542143 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542249 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542454 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542562 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542800 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.542909 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543078 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543224 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543397 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543486 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543695 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.543791 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544003 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544177 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544313 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544418 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544626 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544720 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.544929 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545049 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545261 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545349 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545570 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545656 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545875 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.545969 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546176 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546262 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546492 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546578 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546797 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.546889 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547099 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547191 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547408 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547519 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547711 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.547829 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548019 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548134 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548324 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548547 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548759 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.548895 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549099 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549189 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549407 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549543 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549733 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.549818 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.550093 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.550170 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.550398 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.550483 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.550723 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551041 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551041 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551502 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551502 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551848 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.551848 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.552138 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.552444 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.552606 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.552751 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.552972 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.553153 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.553296 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.553439 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.553583 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.553855 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554183 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554325 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554467 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554621 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554621 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.554903 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.555178 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.555416 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.555705 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.556053 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.556256 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.557407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.557626 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.557778 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.557778 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558066 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558217 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558369 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558512 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558654 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558795 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.558970 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559125 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559125 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559405 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559548 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559690 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559831 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.559997 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560141 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560291 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560575 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560717 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.560868 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561038 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561187 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561329 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561481 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561631 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561786 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.561939 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562083 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562224 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562365 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562507 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562662 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562805 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.562953 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563097 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563237 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563379 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563533 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563687 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.563856 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564106 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564264 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564419 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564563 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564706 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564706 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.564984 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565154 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565309 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565452 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565594 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565753 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.565896 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566038 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566189 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566333 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566743 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.566899 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567042 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567196 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567343 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567485 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567641 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567792 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.567934 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568082 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568223 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568373 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568515 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568666 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568817 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.568959 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569122 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569265 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569408 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569571 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569715 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.569864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.570007 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.570149 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.570299 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.570299 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.570899 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571070 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571215 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571357 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571509 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571670 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571812 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.571954 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572104 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572104 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572383 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572383 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572653 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572795 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.572936 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573110 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573266 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573408 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573562 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573705 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.573866 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574126 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574277 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574419 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574560 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574703 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574845 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.574998 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575149 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575293 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575442 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575594 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575737 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575894 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.575894 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576172 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576314 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576597 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576754 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.576897 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577078 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577227 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577369 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577369 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577677 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577820 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.577962 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578103 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578252 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578403 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578403 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578674 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578817 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.578958 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579100 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579528 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579677 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579827 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.579969 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580119 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580270 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580412 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580554 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580695 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580851 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.580995 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581183 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581603 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581753 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.581903 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582047 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582196 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582338 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582480 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582634 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582778 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.582929 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583080 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583229 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583380 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583523 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583665 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583807 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.583948 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584096 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584319 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584464 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584606 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584758 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.584899 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585109 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585272 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585415 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585558 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585700 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585841 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.585996 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.586146 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.586834 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.586977 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587119 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587272 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587272 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587571 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587761 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.587950 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588095 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588095 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588376 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588527 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588670 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588812 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.588960 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589156 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589303 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589445 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589585 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589732 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.589874 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590029 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590172 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590172 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590453 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590595 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590744 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.590898 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591057 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591199 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591340 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591488 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591639 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591792 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.591935 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592076 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592358 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592508 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592800 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.592947 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593164 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593307 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593470 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593613 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593762 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.593903 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594044 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594193 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594335 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594483 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594636 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594776 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.594917 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595066 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595209 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595349 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595490 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595631 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595779 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.595929 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596071 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596375 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596666 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596809 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.596950 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597134 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597253 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597373 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597544 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597643 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.597871 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.598162 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.598395 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.598642 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.598808 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.598954 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599096 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599246 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599246 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599517 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599669 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.599812 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600021 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600221 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600435 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600595 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.600978 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.601182 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.601377 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.601562 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.601720 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.602006 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.602740 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.602936 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.603140 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.603306 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.603460 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.603796 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.603796 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604093 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604235 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604235 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604514 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604658 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604799 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.604941 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605113 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605269 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605461 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605613 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605766 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.605909 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606052 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606203 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606352 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606495 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606495 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606769 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.606919 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607074 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607218 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607359 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607508 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607660 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607801 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.607951 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608264 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608406 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608548 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608697 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608840 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.608981 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609180 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609322 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609453 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609612 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609743 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.609872 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610006 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610166 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610309 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610460 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610603 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610603 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.610879 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611020 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611161 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611322 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611473 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611614 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611762 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.611904 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612053 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612194 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612336 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612476 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612623 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612771 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.612932 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613102 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613257 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613399 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613550 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613699 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.613922 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614067 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614209 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614350 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614492 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614633 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614784 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.614927 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615068 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615219 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615361 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615516 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615658 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615807 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.615948 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616089 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616229 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616383 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616533 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616675 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616815 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.616966 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617160 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617320 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617497 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617646 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617788 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.617930 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618091 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618235 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618376 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618376 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618644 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618792 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.618952 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.619094 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.619243 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.619500 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.619656 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.619801 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620072 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620231 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620407 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620562 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620735 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.620894 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621102 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621330 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621480 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621674 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621833 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.621988 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622139 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622331 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622481 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622672 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622823 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.622973 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623117 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623268 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623409 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623577 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623740 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.623898 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624040 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624205 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624357 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624505 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624695 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624842 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.624986 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625201 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625346 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625487 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625642 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625784 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.625932 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626074 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626216 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626357 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626506 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626655 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626797 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.626938 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.627103 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.627254 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.627397 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.627788 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.627931 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628073 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628215 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628371 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628518 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628666 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628809 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.628950 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629138 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629294 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629445 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629594 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629736 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.629884 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630025 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630177 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630319 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630467 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630610 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630758 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.630909 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631068 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631211 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631353 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631500 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631641 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631795 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.631938 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632079 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632222 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632364 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632505 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632655 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.632804 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.633091 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.633251 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.633456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.633619 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.633763 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634052 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634203 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634398 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634546 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634720 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.634872 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635043 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635204 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635347 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635489 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635661 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635815 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.635957 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636098 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636277 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636433 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636586 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636727 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.636899 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637086 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637248 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637399 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637542 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637683 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637831 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.637973 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638146 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638306 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638450 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638592 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638744 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.638885 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639036 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639189 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639332 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639483 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639653 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639803 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.639954 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640103 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640252 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640394 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640542 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640694 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.640893 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641275 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641418 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641568 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641711 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.641865 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642015 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642156 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642297 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642438 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642579 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642807 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.642964 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643113 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643263 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643423 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643642 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643799 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.643949 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644097 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644240 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644381 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644532 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644675 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644815 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.644971 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645139 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645283 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645435 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645587 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645730 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.645879 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646022 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646172 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646324 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646467 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646608 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646759 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.646901 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647051 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647193 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647334 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647484 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647626 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647774 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.647926 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.648069 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.648210 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.648352 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.648492 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.648653 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.649362 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.649506 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.649654 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.649797 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:22:05.650066 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.650501 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.650830 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.651149 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.651464 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.651779 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.652112 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.652446 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.652757 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.653112 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.653434 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.653759 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.654077 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.654389 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.654721 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.655035 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.655349 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.655660 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.655971 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.656281 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.656597 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.656910 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.657244 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.657562 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.657878 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.658205 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.658531 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.658844 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.659172 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.659500 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.659851 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.660166 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.660509 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.660847 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.661182 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.661499 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.661808 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:22:05.662057 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:22:05.805698 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Registered counter for database nova_api Aug 23 22:22:05.819664 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Registered counter for database nova_api Aug 23 22:22:05.827688 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.834815 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:05.841568 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.848545 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:05.895143 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.context [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50e9abbb-8f95-4d24-95a3-13ba3d95fa34(cell1) {{(pid=105986) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:22:05.899526 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:05.900159 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:05.901791 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:05.902525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:05.902967 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:05.904970 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:05.906917 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.context [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50e9abbb-8f95-4d24-95a3-13ba3d95fa34(cell1) {{(pid=105985) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:22:05.907050 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Registered counter for database nova_cell0 Aug 23 22:22:05.910864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:05.911354 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:05.912718 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Registered counter for database nova_cell1 Aug 23 22:22:05.912940 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:05.913718 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:05.914163 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:05.917109 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:05.919166 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Registered counter for database nova_cell0 Aug 23 22:22:05.921145 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.922425 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.925113 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Registered counter for database nova_cell1 Aug 23 22:22:05.928938 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:05.932278 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:05.933871 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.934710 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:05.941786 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:05.943252 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:06.077538 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Registered counter for database nova_cell0 Aug 23 22:22:06.088095 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:06.091412 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Registered counter for database nova_cell0 Aug 23 22:22:06.092818 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:06.101230 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:22:06.107070 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:22:06.519206 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:22:06.526752 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:22:06.527225 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:22:06.533980 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:22:06.876834 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:22:06.880499 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:22:06.883724 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:22:06.887290 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:22:06.889136 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f09ed5f9c0 pid: 105986 (default app) Aug 23 22:22:06.891383 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:06.892610 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f09ed5f9c0 pid: 105985 (default app) Aug 23 22:22:06.892721 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-03caf3ff-e7b3-4d33-b51b-2b44ac142e8e None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001889 Aug 23 22:22:06.893055 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Tue Aug 23 22:22:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:34.891544 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:34.893436 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002738 Aug 23 22:23:34.894482 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:34.911509 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.912978 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell0:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.913755 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell1:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.914478 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:35.857894 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-248a9b27-50b7-47eb-969d-f9dd6348138c admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:35.891984 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-248a9b27-50b7-47eb-969d-f9dd6348138c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.990599 Aug 23 22:23:35.892719 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1292 bytes} [Tue Aug 23 22:23:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:23:38.328938 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:38.329968 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-cf889c2c-2c55-47c0-9ade-fc3922ce0c14 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 23 22:23:38.330571 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 2/4] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:38.761658 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-61c4d5dc-a4f6-440e-adf2-ff150408961a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:38.788152 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:38.788152 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: warnings.warn(msg) Aug 23 22:23:38.878603 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-61c4d5dc-a4f6-440e-adf2-ff150408961a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.540620 Aug 23 22:23:38.879206 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 3/5] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:23:39.110565 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-dc025d59-2dad-4dc4-8d93-8454bc1cda90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:39.115681 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:39.115681 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:23:39.118469 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.119275 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.120276 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell1:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.120916 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.243514 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-dc025d59-2dad-4dc4-8d93-8454bc1cda90 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355294 Aug 23 22:23:39.244180 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 3/6] 10.222.0.73 () {64 vars in 1336 bytes} [Tue Aug 23 22:23:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:23:41.693119 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-61c4d5dc-a4f6-440e-adf2-ff150408961a admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:41.694035 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-61c4d5dc-a4f6-440e-adf2-ff150408961a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 23 22:23:41.694457 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 4/7] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:42.418821 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-711d8ef2-df87-4591-9d9f-981860760653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:42.438941 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:42.438941 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:23:42.584169 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-711d8ef2-df87-4591-9d9f-981860760653 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.882854 Aug 23 22:23:42.585175 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 4/8] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:23:42.598541 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-f0569943-4aa7-4295-8e2b-7854d4be95b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:42.601563 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:42.601563 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: warnings.warn(msg) Aug 23 22:23:42.789334 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-f0569943-4aa7-4295-8e2b-7854d4be95b4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.195476 Aug 23 22:23:42.797714 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 5/9] 10.222.0.73 () {64 vars in 1336 bytes} [Tue Aug 23 22:23:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:23:45.240018 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-711d8ef2-df87-4591-9d9f-981860760653 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:45.241269 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-711d8ef2-df87-4591-9d9f-981860760653 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Aug 23 22:23:45.241751 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:45.654320 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3c1e1603-2050-4813-a17f-1883297b083a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "ram": 1024, "vcpus": 1, "id": "d2"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:45.747700 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3c1e1603-2050-4813-a17f-1883297b083a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499706 Aug 23 22:23:45.748526 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 6/11] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:23:45.760911 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-ee6b90dd-1319-46eb-b8e9-26d59e3d45e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:45.863104 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-ee6b90dd-1319-46eb-b8e9-26d59e3d45e5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105211 Aug 23 22:23:45.863699 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 6/12] 10.222.0.73 () {64 vars in 1336 bytes} [Tue Aug 23 22:23:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:23:48.303584 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3c1e1603-2050-4813-a17f-1883297b083a admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:48.304776 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3c1e1603-2050-4813-a17f-1883297b083a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 23 22:23:48.305638 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 7/13] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:23:48.768664 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-fdb00784-ddfe-4b37-80dd-f41fbb017e47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:48.888565 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-fdb00784-ddfe-4b37-80dd-f41fbb017e47 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.576312 Aug 23 22:23:48.889550 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 7/14] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:23:48.904193 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-a9265f3f-ef68-41e2-8067-84398c260bcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:48.999882 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-a9265f3f-ef68-41e2-8067-84398c260bcd admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100156 Aug 23 22:23:49.000783 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 8/15] 10.222.0.73 () {64 vars in 1336 bytes} [Tue Aug 23 22:23:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:23:51.472340 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-fdb00784-ddfe-4b37-80dd-f41fbb017e47 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:51.473601 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-fdb00784-ddfe-4b37-80dd-f41fbb017e47 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Aug 23 22:23:51.474121 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 8/16] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:52.015112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "swap": 0}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:52.094900 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.613945 Aug 23 22:23:52.095910 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 9/17] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:23:52.108869 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-140ff017-75b5-4f86-a3f8-0d24c26fb6a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:52.196487 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-140ff017-75b5-4f86-a3f8-0d24c26fb6a5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090472 Aug 23 22:23:52.201266 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 9/18] 10.222.0.73 () {64 vars in 1336 bytes} [Tue Aug 23 22:23:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:23:54.702818 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:54.703982 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 23 22:23:54.704482 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 10/19] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:23:55.225673 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-4befeff5-28df-4251-b0db-a13de67516be admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:55.255243 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-4befeff5-28df-4251-b0db-a13de67516be admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.543441 Aug 23 22:23:55.255836 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 10/20] 10.222.0.73 () {60 vars in 1292 bytes} [Tue Aug 23 22:23:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:23:58.163931 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:23:58.164853 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-02e98937-3651-46c9-a812-6c4c1f6bbd55 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 23 22:23:58.165293 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 11/21] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:23:58.601427 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-0d4ba491-e76d-44d6-b147-2b7fc4319770 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:58.679242 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-0d4ba491-e76d-44d6-b147-2b7fc4319770 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.507346 Aug 23 22:23:58.686932 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 11/22] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:23:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:23:58.693498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-a875c3e8-15d3-4584-ba46-b58b2f84da18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:23:58.780656 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-a875c3e8-15d3-4584-ba46-b58b2f84da18 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091109 Aug 23 22:23:58.781302 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 12/23] 10.222.0.73 () {64 vars in 1333 bytes} [Tue Aug 23 22:23:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:01.222022 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-0d4ba491-e76d-44d6-b147-2b7fc4319770 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:01.223005 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-0d4ba491-e76d-44d6-b147-2b7fc4319770 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Aug 23 22:24:01.223408 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 12/24] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:01.589126 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-24be5be8-1d7c-4b4d-9c21-55d2cf683c62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "vcpus": 1}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:01.676217 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-24be5be8-1d7c-4b4d-9c21-55d2cf683c62 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446347 Aug 23 22:24:01.676792 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 13/25] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:24:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:01.689230 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-dd771646-ad6e-46ad-a7ec-d9f656413809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:01.773952 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-dd771646-ad6e-46ad-a7ec-d9f656413809 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088356 Aug 23 22:24:01.774451 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 13/26] 10.222.0.73 () {64 vars in 1333 bytes} [Tue Aug 23 22:24:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:04.262547 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-24be5be8-1d7c-4b4d-9c21-55d2cf683c62 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:04.325126 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-24be5be8-1d7c-4b4d-9c21-55d2cf683c62 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 23 22:24:04.325126 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 14/27] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:04.753379 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-767e0e73-e109-430e-86c6-266140da985f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:04.936466 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-767e0e73-e109-430e-86c6-266140da985f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.665442 Aug 23 22:24:04.937142 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 14/28] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:24:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:24:04.949903 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-2d29c5a3-105a-41c4-823b-e9ec1748989f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:05.060320 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:05.067275 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-2d29c5a3-105a-41c4-823b-e9ec1748989f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121027 Aug 23 22:24:05.067869 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 15/29] 10.222.0.73 () {64 vars in 1333 bytes} [Tue Aug 23 22:24:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:07.498717 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-767e0e73-e109-430e-86c6-266140da985f admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:07.499727 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-767e0e73-e109-430e-86c6-266140da985f admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 23 22:24:07.500129 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 15/30] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:24:07.976932 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-c4f121a9-2d7c-4d12-a44d-7f28c403ac4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:08.052920 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-c4f121a9-2d7c-4d12-a44d-7f28c403ac4a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545601 Aug 23 22:24:08.060662 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 16/31] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:24:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:08.066412 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-b4b3dfaa-5eab-4e9f-a8f3-98be9bd59490 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:08.148065 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-b4b3dfaa-5eab-4e9f-a8f3-98be9bd59490 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085871 Aug 23 22:24:08.149078 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 16/32] 10.222.0.73 () {64 vars in 1333 bytes} [Tue Aug 23 22:24:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:10.685326 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-c4f121a9-2d7c-4d12-a44d-7f28c403ac4a admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:10.686258 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-c4f121a9-2d7c-4d12-a44d-7f28c403ac4a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 23 22:24:10.686880 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 17/33] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:11.229670 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "vcpus": 8, "swap": 0}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:11.238303 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:11.359300 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.664620 Aug 23 22:24:11.360330 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 17/34] 10.222.0.73 () {64 vars in 1283 bytes} [Tue Aug 23 22:24:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:11.373105 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-647374d0-ac4a-4a13-9adb-bdc47d78c18a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:11.492828 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-647374d0-ac4a-4a13-9adb-bdc47d78c18a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124271 Aug 23 22:24:11.493449 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 18/35] 10.222.0.73 () {64 vars in 1333 bytes} [Tue Aug 23 22:24:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:29.999859 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:30.000991 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 23 22:24:30.001427 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 18/36] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:30.012239 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=2,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:30.415649 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3a9d185d-dc59-4dc6-a117-5e98ee6ef10b admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:30.433815 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3a9d185d-dc59-4dc6-a117-5e98ee6ef10b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426075 Aug 23 22:24:30.434354 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1292 bytes} [Tue Aug 23 22:24:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:31.519963 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:31.521001 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-892c1aef-99ee-4a69-94c3-278530e78e87 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 23 22:24:31.521436 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 19/38] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:32.061106 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-8d69cb59-ed65-455c-91fe-ff1e0483aa37 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:32.067202 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-8d69cb59-ed65-455c-91fe-ff1e0483aa37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-8d69cb59-ed65-455c-91fe-ff1e0483aa37 admin admin] Request method failure captured: Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept: application/json Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.73 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjBVOf15cFGwGzRmk7zCMc5DeW8DjDT8yFScF_obsH5GH8sq6Jew3Dng6k4d5yLUPREPNAoByLzcZHz5ljKQAqDvZ6hX1_Dnz0Q2n89AjQE2QP5b2_9yrhA0nErOAfm2gprK0SL_ndLmfdiLU_hE5Y42ReKGhHD2_X6TC7oyWd2d0TIIc Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Role: reader,admin,member Aug 23 22:24:32.070498 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,admin,member Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User: admin Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: method: > Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: exception: Flavor 42 could not be found. Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '42'} Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:32.072176 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:32.073260 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.074589 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-8d69cb59-ed65-455c-91fe-ff1e0483aa37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:32.075865 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-8d69cb59-ed65-455c-91fe-ff1e0483aa37 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.412320 Aug 23 22:24:32.075865 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 20/39] 10.222.0.73 () {60 vars in 1190 bytes} [Tue Aug 23 22:24:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:32.082749 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-db02842b-2fc8-4dc2-98aa-e114cd40d553 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:32.104974 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-db02842b-2fc8-4dc2-98aa-e114cd40d553 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026897 Aug 23 22:24:32.105555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 20/40] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:32.115938 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-7bc891c0-68bc-43ef-a355-c23374806a58 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:32.142389 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-7bc891c0-68bc-43ef-a355-c23374806a58 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029987 Aug 23 22:24:32.142938 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 21/41] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:32.153513 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-6de1440c-3440-4984-94bd-82506e1180d4 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:32.160035 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-6de1440c-3440-4984-94bd-82506e1180d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-6de1440c-3440-4984-94bd-82506e1180d4 admin admin] Request method failure captured: Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept: application/json Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.73 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjBVOf15cFGwGzRmk7zCMc5DeW8DjDT8yFScF_obsH5GH8sq6Jew3Dng6k4d5yLUPREPNAoByLzcZHz5ljKQAqDvZ6hX1_Dnz0Q2n89AjQE2QP5b2_9yrhA0nErOAfm2gprK0SL_ndLmfdiLU_hE5Y42ReKGhHD2_X6TC7oyWd2d0TIIc Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Role: reader,admin,member Aug 23 22:24:32.163406 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,admin,member Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User: admin Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: method: > Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: exception: Flavor 42 could not be found. Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '42'} Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:32.165040 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:32.166030 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:32.167439 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-6de1440c-3440-4984-94bd-82506e1180d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:32.168689 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-6de1440c-3440-4984-94bd-82506e1180d4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015662 Aug 23 22:24:32.168689 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 21/42] 10.222.0.73 () {60 vars in 1190 bytes} [Tue Aug 23 22:24:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:33.153718 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-7bc891c0-68bc-43ef-a355-c23374806a58 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:33.154719 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-7bc891c0-68bc-43ef-a355-c23374806a58 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 23 22:24:33.155138 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 22/43] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:33.715061 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-654d5fad-2963-4eef-9636-9757804036c6 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:33.723420 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-654d5fad-2963-4eef-9636-9757804036c6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-654d5fad-2963-4eef-9636-9757804036c6 admin admin] Request method failure captured: Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept: application/json Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.73 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjBVOhuuDxf3XK40ZxFdulVs4c7pvdo48BnmQmmBRZoHPbXuyIWdodNOr-Ltwt1waVUhMMXbxL8fpScMI6s--UfoRomqGHh-uKeTKwWSXliuwQSQHueQ8OTJkrfRxxd2Uz_-LUGVhzyxNBI63y3gAcF6Oqq8bddaa3EoNZYhK_OOgRaIY Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Role: reader,admin,member Aug 23 22:24:33.724958 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,admin,member Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User: admin Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: method: > Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: exception: Flavor 84 could not be found. Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '84'} Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:33.726456 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:33.727463 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.728555 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-654d5fad-2963-4eef-9636-9757804036c6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:33.729585 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-654d5fad-2963-4eef-9636-9757804036c6 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427298 Aug 23 22:24:33.729585 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1190 bytes} [Tue Aug 23 22:24:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:33.737133 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bb1c900c-260c-4bfc-99e5-ae0512aec00d admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:33.752644 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bb1c900c-260c-4bfc-99e5-ae0512aec00d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019784 Aug 23 22:24:33.753235 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 23/45] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:33.763375 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-c8a5b7b4-9c2e-44ae-898b-5412ecd40415 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:33.778848 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-c8a5b7b4-9c2e-44ae-898b-5412ecd40415 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018955 Aug 23 22:24:33.779416 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 23/46] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:33.789712 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-85b8b16c-b65a-4cb1-bd17-1cc36338ed92 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:33.795142 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-85b8b16c-b65a-4cb1-bd17-1cc36338ed92 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-85b8b16c-b65a-4cb1-bd17-1cc36338ed92 admin admin] Request method failure captured: Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept: application/json Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.73 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjBVOhuuDxf3XK40ZxFdulVs4c7pvdo48BnmQmmBRZoHPbXuyIWdodNOr-Ltwt1waVUhMMXbxL8fpScMI6s--UfoRomqGHh-uKeTKwWSXliuwQSQHueQ8OTJkrfRxxd2Uz_-LUGVhzyxNBI63y3gAcF6Oqq8bddaa3EoNZYhK_OOgRaIY Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Role: reader,admin,member Aug 23 22:24:33.796680 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,admin,member Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User: admin Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: method: > Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: exception: Flavor 84 could not be found. Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '84'} Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:33.799434 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:33.800525 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:33.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-85b8b16c-b65a-4cb1-bd17-1cc36338ed92 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:33.803086 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-85b8b16c-b65a-4cb1-bd17-1cc36338ed92 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013154 Aug 23 22:24:33.803086 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 24/47] 10.222.0.73 () {60 vars in 1190 bytes} [Tue Aug 23 22:24:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:34.802641 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-c8a5b7b4-9c2e-44ae-898b-5412ecd40415 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:34.803647 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-c8a5b7b4-9c2e-44ae-898b-5412ecd40415 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 23 22:24:34.804049 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 24/48] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:35.462531 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-eabbeab6-ca91-465a-b76c-750e72ee7ddb admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:35.468383 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-eabbeab6-ca91-465a-b76c-750e72ee7ddb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-eabbeab6-ca91-465a-b76c-750e72ee7ddb admin admin] Request method failure captured: Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept: application/json Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.73 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjBVOin4R_3xx_72Qtns5zVPHF3xwJCoRnCYQnDSOxh38soxGe4lA84d421qerpIs6gqlTCAWTXj-JMDWy_krGIdUUWuy4E6deKFbIqHAJQA8SPyFNtYGgPfjB3W1ta7U7CEhCWx8dfQriuq76G60lT_DE_yWGnjLqX_VRzYTjYb4RPe0 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Role: reader,admin,member Aug 23 22:24:35.470517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,admin,member Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User: admin Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: method: > Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: exception: Flavor 451 could not be found. Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '451'} Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:35.472112 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:35.473116 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.474214 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-eabbeab6-ca91-465a-b76c-750e72ee7ddb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:35.475234 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-eabbeab6-ca91-465a-b76c-750e72ee7ddb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.529575 Aug 23 22:24:35.475234 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 25/49] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:24:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 531 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:35.481816 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-8d3ccdaa-0422-4645-ac4e-3c3b95846f11 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:35.497648 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-8d3ccdaa-0422-4645-ac4e-3c3b95846f11 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019321 Aug 23 22:24:35.498209 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 25/50] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:35.507958 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:35.523957 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019539 Aug 23 22:24:35.524517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 26/51] 10.222.0.73 () {60 vars in 1210 bytes} [Tue Aug 23 22:24:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:35.534635 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-5b1c26a8-373d-4484-8adc-aa54c472f69d admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:35.539961 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-5b1c26a8-373d-4484-8adc-aa54c472f69d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-5b1c26a8-373d-4484-8adc-aa54c472f69d admin admin] Request method failure captured: Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept: application/json Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.73 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.90 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjBVOin4R_3xx_72Qtns5zVPHF3xwJCoRnCYQnDSOxh38soxGe4lA84d421qerpIs6gqlTCAWTXj-JMDWy_krGIdUUWuy4E6deKFbIqHAJQA8SPyFNtYGgPfjB3W1ta7U7CEhCWx8dfQriuq76G60lT_DE_yWGnjLqX_VRzYTjYb4RPe0 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Role: reader,admin,member Aug 23 22:24:35.541474 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,admin,member Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6d681c62c63c41f3b7033ae72341d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6d681c62c63c41f3b7033ae72341d972", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 6d681c62c63c41f3b7033ae72341d972 Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User: admin Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Id: 0f6d02bd20804957aa92efbfa08393a0 Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: method: > Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: exception: Flavor 451 could not be found. Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '451'} Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:35.543034 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:35.544231 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Aug 23 22:24:35.545649 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-5b1c26a8-373d-4484-8adc-aa54c472f69d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:35.546848 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-5b1c26a8-373d-4484-8adc-aa54c472f69d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012455 Aug 23 22:24:35.546848 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 26/52] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:24:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:36.540180 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:36.541223 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 23 22:24:36.541621 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 27/53] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:37.123890 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-233f13f7-1988-4419-b49c-4160960a5e36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:37.201831 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-233f13f7-1988-4419-b49c-4160960a5e36 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.514749 Aug 23 22:24:37.203896 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 27/54] 10.222.0.73 () {64 vars in 1235 bytes} [Tue Aug 23 22:24:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:38.196261 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:38.197339 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 23 22:24:38.197741 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:38.735799 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-908d190b-070b-490d-855c-4791ffc117d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:38.815983 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-908d190b-070b-490d-855c-4791ffc117d0 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.477010 Aug 23 22:24:38.816570 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 28/56] 10.222.0.73 () {64 vars in 1235 bytes} [Tue Aug 23 22:24:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:39.808834 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:39.809832 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 23 22:24:39.810241 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 29/57] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:40.353204 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-56292f6c-7709-47a0-9256-07ed7a5607c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:40.479418 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-56292f6c-7709-47a0-9256-07ed7a5607c2 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.528385 Aug 23 22:24:40.479969 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 29/58] 10.222.0.73 () {64 vars in 1235 bytes} [Tue Aug 23 22:24:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:41.464403 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:41.465517 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 23 22:24:41.465905 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 30/59] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:42.001651 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-d5513087-9293-478a-92bb-69f3bd61ab59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:42.119719 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-d5513087-9293-478a-92bb-69f3bd61ab59 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.511350 Aug 23 22:24:42.120240 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 30/60] 10.222.0.73 () {64 vars in 1235 bytes} [Tue Aug 23 22:24:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:24:43.126777 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:43.127797 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 23 22:24:43.128205 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 31/61] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:43.664765 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-523597d5-01b5-4e55-b0c3-0889ed7a6fe8 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:43.686198 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-523597d5-01b5-4e55-b0c3-0889ed7a6fe8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420516 Aug 23 22:24:43.686705 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 31/62] 10.222.0.73 () {60 vars in 1202 bytes} [Tue Aug 23 22:24:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:38.904080 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:38.905259 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1feeac76-873a-4d94-a5f3-8422d2c2d075 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Aug 23 22:25:38.905656 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 32/63] 10.222.0.73 () {54 vars in 931 bytes} [Tue Aug 23 22:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:38.916563 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:39.309985 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f547a753-dc74-4226-8024-739c27d321f4 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.330484 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f547a753-dc74-4226-8024-739c27d321f4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.418326 Aug 23 22:25:39.331033 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 32/64] 10.222.0.73 () {60 vars in 1292 bytes} [Tue Aug 23 22:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:39.351858 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=14 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:39.355567 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-8467260b-99b5-436e-8acd-d7f6edcd4ef7 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.363699 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-8467260b-99b5-436e-8acd-d7f6edcd4ef7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013210 Aug 23 22:25:39.364230 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 33/65] 10.222.0.73 () {60 vars in 1283 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:39.377050 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-db1b4683-57aa-4ad6-985f-23145daa5c11 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.384720 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-db1b4683-57aa-4ad6-985f-23145daa5c11 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011337 Aug 23 22:25:39.385294 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 33/66] 10.222.0.73 () {60 vars in 1286 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:39.397688 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.406052 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012368 Aug 23 22:25:39.406571 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 34/67] 10.222.0.73 () {60 vars in 1286 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:39.419094 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f3e11520-089f-4f7e-9827-cc7374179d5a admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.426981 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f3e11520-089f-4f7e-9827-cc7374179d5a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012056 Aug 23 22:25:39.427512 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 34/68] 10.222.0.73 () {60 vars in 1283 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:58.558317 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:58.558864 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Aug 23 22:28:58.559275 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 35/69] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:58.702888 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=6 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:58.867135 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:58.869473 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:28:58.869473 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:28:58.870814 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:58.871273 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:58.871689 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:58.872422 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:58.872854 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:58.873288 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:58.911864 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-35da551c-4393-42f6-ae04-2fa7170e46a4 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210200 Aug 23 22:28:58.912556 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 35/70] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:28:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:28:59.781405 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:59.782460 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 23 22:28:59.782881 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 36/71] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:00.003435 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:00.005962 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:29:00.005962 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:29:00.007132 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.007611 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.008067 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:00.008784 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.009262 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.009674 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:00.031855 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-7d8101a1-2c95-483b-b7f9-e2c282082e8a admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084498 Aug 23 22:29:00.032435 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 36/72] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:28:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:29:11.307679 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.314462 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 Aug 23 22:29:11.318131 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 37/73] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:11.457081 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=4 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.457825 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell1:SELECT=4 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.458470 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=8 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.512579 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.515330 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:29:11.515330 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:29:11.516449 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.516926 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.517384 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.518102 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.518618 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.518993 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.545322 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-6bafee42-86f2-4092-b5e6-f9a3a7a727e9 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097867 Aug 23 22:29:11.545895 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 37/74] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:29:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:29:12.378844 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:12.379904 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b439dffe-7805-41c4-9f52-08d18deec604 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 23 22:29:12.380299 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 38/75] 10.222.0.73 () {56 vars in 1074 bytes} [Tue Aug 23 22:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:12.582256 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:12.585834 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:29:12.585834 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: warnings.warn(msg) Aug 23 22:29:12.587374 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:12.588049 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:12.588722 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:12.589684 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:12.590320 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:12.590903 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:12.623603 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-64a803f2-51ed-4cb0-a868-1f98a09f8d1f admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100090 Aug 23 22:29:12.624166 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 38/76] 10.222.0.73 () {60 vars in 1193 bytes} [Tue Aug 23 22:29:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:12.408659 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: Tue Aug 23 22:30:12 2022 - graceful shutdown triggered... Aug 23 22:30:12.409309 dv-cinder-842542-4-iscsi devstack@n-api.service[105986]: Gracefully killing worker 2 (pid: 105986)... Aug 23 22:30:12.409788 dv-cinder-842542-4-iscsi devstack@n-api.service[105985]: Gracefully killing worker 1 (pid: 105985)... Aug 23 22:30:12.410831 dv-cinder-842542-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 22:30:13.409185 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: worker 1 buried after 1 seconds Aug 23 22:30:13.409185 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: worker 2 buried after 1 seconds Aug 23 22:30:13.409185 dv-cinder-842542-4-iscsi devstack@n-api.service[105984]: goodbye to uWSGI. Aug 23 22:30:13.410681 dv-cinder-842542-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 22:30:13.411238 dv-cinder-842542-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 22:30:13.414113 dv-cinder-842542-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 22:30:13.423897 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:30:13 2022] *** Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: nodename: dv-cinder-842542-4-iscsi Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: machine: x86_64 Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: clock source: unix Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: pcre jit disabled Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: detected number of CPU cores: 4 Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: current working directory: / Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:30:13.426008 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: your processes number limit is 47680 Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: your memory page size is 4096 bytes Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: detected max file descriptor number: 2048 Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: lock engine: pthread robust mutexes Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: thunder lock: enabled Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 22:30:13.426738 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:30:13.468158 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: Python main interpreter initialized at 0x5598a8e6d9c0 Aug 23 22:30:13.468158 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: python threads support enabled Aug 23 22:30:13.468158 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: your server socket listen backlog is limited to 100 connections Aug 23 22:30:13.468158 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:30:13.468561 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:30:13.468561 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: *** Operational MODE: preforking *** Aug 23 22:30:13.468861 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:30:13.468861 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: spawned uWSGI master process (pid: 121879) Aug 23 22:30:13.474741 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: spawned uWSGI worker 1 (pid: 121884, cores: 1) Aug 23 22:30:13.474741 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: spawned uWSGI worker 2 (pid: 121885, cores: 1) Aug 23 22:30:13.474741 dv-cinder-842542-4-iscsi devstack@n-api.service[121879]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:30:13.469080 dv-cinder-842542-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 22:30:14.203496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:30:14.259484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:30:15.549050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:30:15.549050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: from cryptography.utils import int_from_bytes Aug 23 22:30:15.549050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:30:15.549050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: from cryptography.utils import int_from_bytes Aug 23 22:30:15.576178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:30:15.576178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: from cryptography.utils import int_from_bytes Aug 23 22:30:15.577199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:30:15.577199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: from cryptography.utils import int_from_bytes Aug 23 22:30:18.169595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:30:18.170219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:30:18.170413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:30:18.170788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:30:18.171052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:30:18.171452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.171789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.172118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.172479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.172945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.173300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.173640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.173974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.174316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.174589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.174920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.175253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-4-iscsi {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.175587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.175904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.176225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.176560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.176870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.177229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.177684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.178626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.179403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.179796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.180139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.180484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.180819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.181550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.181550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.181800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.182138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.182460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.182879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-4-iscsi {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.183207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.183530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.183858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.184298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.184621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.184955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.185990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.185990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.185990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.186272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.186593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.186925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.187256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.187584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.187888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.188223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.188538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.188863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.189206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.189465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.189780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.190115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.190442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.190775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.191034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.191291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.191619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.191948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.192263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.192605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.192888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.193227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.193543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.194495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.194923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.195243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.195577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.195901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.196233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.196548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.196876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.197398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.197657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.197973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.198326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.198655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.198976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.199306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.199636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.199950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.200267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.200581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.200915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.201300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.201614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.201866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.202179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.202493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.202820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.203133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.203447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.203760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.204068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.204381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.204759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.205106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.205423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.205738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.206051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.206363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.206676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.206989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.207322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.207650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.207983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.208280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.208597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.208908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.209882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.210201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.210516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.210850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.211164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.211475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.211863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.212117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.212488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.212757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.213085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.213406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.213728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.214037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.214347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.214667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.214967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.215279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.215589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.215896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.216208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.216516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.216842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.217195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.217516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.217828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.218139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.218466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.218816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.219165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.219519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.219844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.220188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.220526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.220853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.221201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.221521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.221858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.222179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.222807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.222807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.223128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.223453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.223822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.224138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.224477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.224784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.225832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.226078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.226422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.226748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.227068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.227418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.227807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.228101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.228469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.233213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.233213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.233533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:30:18.233955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:30:18.234150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:30:18.234456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:30:18.234545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:30:18.234715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.234867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.234948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.235027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.235106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.235178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.235334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.235427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.235512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.235603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.235696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.235789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.235900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.236149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.236257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.236350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.236437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.236536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.236623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.236707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.236791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.236883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.236964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.237070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-4-iscsi {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.237234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.237307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.237526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.237895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.237996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.238180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.238358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.238704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.238858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.238943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.239076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.239174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.239268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.239360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.239445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.239584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.239723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.239862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.240003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.240245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.240377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.240377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.240591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.240711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.241085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.241273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.241478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.241701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.241903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.242011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.242086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-4-iscsi {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.242292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.242385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.242609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.242722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.242924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.243026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.243247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.243400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.243569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.243752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.243893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.244048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.244193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.244378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.244513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.244710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.244848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.245077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.245208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.245432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.245540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.245767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.245872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.246123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.246271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.246436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.246544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.246749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.246842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.247066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.247167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.247388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.247493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.247725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.247817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.248044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.248144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.248386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.248495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.248623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.248763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.248938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.249090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.249298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.249393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.249610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.249702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.249922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.250070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.250223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.250314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.250481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.250574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.250811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.250955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.251140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.251236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.251455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.251554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.251767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.251867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.252075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.252177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.252388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.252489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.252734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.252841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.253068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.253163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.253385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.253594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.253730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.254064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.254181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.254386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.254489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.254739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.254841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.255054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.255150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.255387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.255490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.255714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.255853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.256031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.256206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.256403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.256607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.256804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.257083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.257277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.257434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.257533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.257757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.257851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.258092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.258209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.258426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.258638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.258783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.258970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.259088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.259279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.259432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.259626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.259784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.259963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.260124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.260338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.260456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.260665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.260842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.261072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.261265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.261388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.261685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.261886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.262057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.262248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.262454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.262640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.262827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.263007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.263007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.263373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.263566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.263664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.263800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.264030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.264248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.264413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.264564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.264729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.264964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.265117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.265430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.265605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.265752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.265931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.266097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.266264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.266420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.266581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.266740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.266908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.267078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.267252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.267415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.267598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.267735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.267920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.268053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.268242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.268394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.268574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.268712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.268895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.269082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.269250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.269407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.269573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.269725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.269889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.270060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.270211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.270396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.270590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.270751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.270917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.271088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.271240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.271409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.271563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.271726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.272438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.272565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.272771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.272945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.273134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.273307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.273487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.273609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.273703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.273877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.274031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.274139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.274365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.274461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.274687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.274781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.275020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.275129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.275341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.275433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.275656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.275763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.275972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.276080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.276285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.276385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.276611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.276749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.276925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.277054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.277274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.277378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.277587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.277687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.277898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.277999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.278228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:30:18.278323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.278546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.278639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.278875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.278970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.279209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.279309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.279533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.279629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.279874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.280908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.281268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.281433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.281657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.281823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.281980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.282835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.283843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.284945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.285079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.285411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.285549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.285746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.285895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.286070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.286222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.286428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.286583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.286819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.287045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.287196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.287360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.287601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.288388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.288567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.288723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.288891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.289188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.289287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.289512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.289611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.289837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.290898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.291108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.291209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.291436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.291703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.291897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.292920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.293131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.293306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.293478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.293663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.293985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.294319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.294650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.295031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.295436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.295792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.296129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.296472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.296591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.296792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.296922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.297145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.297323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.297575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.297811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.298021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.298229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.298452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.298674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.298899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.299115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.299326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.299516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.299710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.299944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.300158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.300373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.300585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.300787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.300985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.301265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.301461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.301712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.301869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.302877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.303947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.304128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.304277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.304446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.304763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.304911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.305786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.306946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.307985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.308987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.309909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.310866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.311859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.312955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.313943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.314924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.315970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.316924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.317914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.318123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.318218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.318437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.318539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.319376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.319542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.319776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.319947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.320815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.321113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.321269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.321513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.321611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.321815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.322878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.323995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.324974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.325157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.325441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.325765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.326782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.327827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.328974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.329930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.330999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.331193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.331397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.331524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.331692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.331821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.332924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.333141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.333278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.333470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.333598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.333974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.334125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.334493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.335353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.336289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.337994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.338833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.339784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.340883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.341168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.341327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.341469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.341549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.342956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.343932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.344942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.345212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.345324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.345647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.345833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.345968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.346278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.346465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.346632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.346817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.347047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.347133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.349931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.350659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.351459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.351692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.351692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.351878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.351984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.352947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.353917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.354870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.355071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.355206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.355753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.355861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.356981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.357947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.358936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.359944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.360992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.361254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.361378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.361597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.361704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.361919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.362957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.363925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.364964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.365157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.365446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.365622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.365845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.365990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.366293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.366465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.366633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.366851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.366969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.367925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.368857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.369095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.369210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.369410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.369541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.369752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.370972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.371932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.372024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.372249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.372443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.372622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.372818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.373954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.374904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.375942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.376128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.376288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.376494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.376758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.376914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.377090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.377346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.377535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.377679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.377820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.378051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.378138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.378211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.378375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.379860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.380915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.381689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.381858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.382944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.383976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.384951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.385174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.385839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.386948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.387802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.388987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.389142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.389337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.389470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.389673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.389866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.390996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.391117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.391322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.391454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.391934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.392943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.393956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.394913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.395723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.395828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.395915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.396912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.397687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.397805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.397986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.398143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.398339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.398610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.398798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.398937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.399992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.400183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.400317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.400518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.400687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.400839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.401857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.402884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.403939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.404995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.405968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.406971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.407906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.408881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.409825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.410838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.411972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.412067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.412295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.412569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.412721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.412818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.413108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.413254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.413460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.413583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.413918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.414937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.415935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.416936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.417253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.417496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.417597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.417825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.417954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.418865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.419870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.420933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.421805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.422054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.422445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.422544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.422628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.422753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.427831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.428171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.428407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.428577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.428743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.428906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.429892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.430931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.431996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.432871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.433888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.434985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.435982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.436921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.437822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.438966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.439110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.439235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.439375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.440384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.440528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.440632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.440775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.440946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.441987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.442978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.443166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.443296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.443406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.443549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.444950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.445905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.446949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.447931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.448997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.449999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.450957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.451231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.451323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.451550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.451654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.451868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.452194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.452293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.452518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.452629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.452901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.453869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.454892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.455896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.456775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:30:18.456994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.457341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.457656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.457978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.458294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.458659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.458974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.459408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.460630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.460994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.461366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.461690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.462018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.462337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.462665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.463066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.463310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.463628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.463974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.465962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.466299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.466621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.466957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.467304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.467629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.467993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.468322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.468933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.469324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.469684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.470060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.470423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.470749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.471065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.471381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.471715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.472035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.472357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.472678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.473001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.473352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.473665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.473987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.474317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.474673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.474963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.475289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.475629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.476215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.476502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.476805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.477195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.477529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.477918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.478178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.478504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.478829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.479152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.479502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.479826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.480148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.480842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.481119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.481436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.481914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.483919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.484207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.484540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.484977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.485254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.485615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.485934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.486272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.486590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.489964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.490284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.490644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.491108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.491467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.491784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.492108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.492448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.492794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.493507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.493507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.493831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.494094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.494455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.494774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.495087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.495438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.495784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.496115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.496477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.496798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.497281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.497611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.497967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.498302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.498631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.499028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.499291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.499618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.499928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.500253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.500595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.500919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.501261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.501596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.501932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.502290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.502637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.502961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.503291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.503612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.503930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.504267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.504587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.504908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.505501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.505672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.505913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.506885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.507107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.507430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.507754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.508078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.508418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.508805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.509096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.509453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.509793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.510198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.510481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.510844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.511186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.511500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.511821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.512164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:30:18.512422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:30:18.526178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO dbcounter [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Registered counter for database nova_api Aug 23 22:30:18.547948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.557378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writer thread running {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.576184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO dbcounter [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Registered counter for database nova_api Aug 23 22:30:18.605067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_db.sqlalchemy.engines [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.614595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writer thread running {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.620558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.context [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50e9abbb-8f95-4d24-95a3-13ba3d95fa34(cell1) {{(pid=121884) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:30:18.624891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.625467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.627035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.627830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.628287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.630311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.633037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO dbcounter [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Registered counter for database nova_cell0 Aug 23 22:30:18.637496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO dbcounter [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Registered counter for database nova_cell1 Aug 23 22:30:18.645764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.649403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.659283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writer thread running {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.660782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writer thread running {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.679751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.context [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50e9abbb-8f95-4d24-95a3-13ba3d95fa34(cell1) {{(pid=121885) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:30:18.684371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.684941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.686633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.687505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.688110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.690544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.692972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO dbcounter [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Registered counter for database nova_cell0 Aug 23 22:30:18.699058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO dbcounter [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Registered counter for database nova_cell1 Aug 23 22:30:18.711319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_db.sqlalchemy.engines [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.712270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_db.sqlalchemy.engines [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.724349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writer thread running {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.726680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writer thread running {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.825284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO dbcounter [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Registered counter for database nova_cell0 Aug 23 22:30:18.833799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.840588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writer thread running {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:18.918996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO dbcounter [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Registered counter for database nova_cell0 Aug 23 22:30:18.927656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_db.sqlalchemy.engines [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:30:18.934474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writer thread running {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:30:19.184882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: WARNING keystonemiddleware.auth_token [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:30:19.192580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: WARNING keystonemiddleware.auth_token [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:30:19.278873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: WARNING keystonemiddleware.auth_token [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:30:19.286417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: WARNING keystonemiddleware.auth_token [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:30:19.562568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: WARNING keystonemiddleware.auth_token [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:30:19.569686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: WARNING keystonemiddleware.auth_token [None req-a2d36b43-f92c-455c-b5ff-1c1933ef0a4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:30:19.575666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598a8e6d9c0 pid: 121884 (default app) Aug 23 22:30:19.642022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: WARNING keystonemiddleware.auth_token [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:30:19.648626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: WARNING keystonemiddleware.auth_token [None req-c77023cd-f54a-4d77-b35c-3cda7cf991dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:30:19.654134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598a8e6d9c0 pid: 121885 (default app) Aug 23 22:30:56.890909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:56.891832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:56.892536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:56.893415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:57.474798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:57.475742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:57.476571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:57.477602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:58.262544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c15544bb-f933-49bb-b8bd-0e38128487f8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Action: 'create', calling method: .version_select at 0x7f5ed2e645e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1160834232", "metadata": {"Type": "work"}}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c15544bb-f933-49bb-b8bd-0e38128487f8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 122 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:30:58.270546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1160834232", "metadata": {"Type": "work"}}} Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: Aug 23 22:30:58.271931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1160834232', 'metadata': {'Type': 'work'}}}} Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:58.272745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:30:58.274529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:30:58.275719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:30:58.275719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:30:58.277744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c15544bb-f933-49bb-b8bd-0e38128487f8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:58.279276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c15544bb-f933-49bb-b8bd-0e38128487f8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.401195 Aug 23 22:30:58.280075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1156 bytes} [Tue Aug 23 22:30:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1403 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:30:58.537816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8b82482c-de2b-4ba6-a0d8-3509daf220ae tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Action: 'create', calling method: .version_select at 0x7f5ed2e685e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2020406521"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:58.742136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-74e06308-fb9f-40f2-9680-a92e6b004f26 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Action: 'create', calling method: .version_select at 0x7f5ed2e64670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2073572920", "metadata": {"Type": "work"}}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:00.967442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8b82482c-de2b-4ba6-a0d8-3509daf220ae tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.498003 Aug 23 22:31:00.978824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1/2] 10.222.0.73 () {60 vars in 1155 bytes} [Tue Aug 23 22:30:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3502 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 23 22:31:00.980405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-467a3c42-76fc-485d-8ffb-f435addf40bc tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Action: 'create', calling method: .version_select at 0x7f5ed2d3b430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-300250750", "metadata": {"Type": "work"}}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-467a3c42-76fc-485d-8ffb-f435addf40bc tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 119 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:01.003413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-300250750", "metadata": {"Type": "work"}}} Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:01.005240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-300250750', 'metadata': {'Type': 'work'}}}} Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi '0' Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.005902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:31:01.006827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:31:01.007760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:31:01.007760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.007760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-467a3c42-76fc-485d-8ffb-f435addf40bc tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.007760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-467a3c42-76fc-485d-8ffb-f435addf40bc tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028001 Aug 23 22:31:01.007760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1156 bytes} [Tue Aug 23 22:31:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:31:01.021539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f0911844-996f-471d-b1ad-bdd115f9d88c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d4de50>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.073827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-74e06308-fb9f-40f2-9680-a92e6b004f26 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.791489 Aug 23 22:31:01.074432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 2/4] 10.222.0.73 () {60 vars in 1156 bytes} [Tue Aug 23 22:30:58 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2794 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 22:31:01.079710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ca30632-42c0-4fa4-bef8-05de4ee9ed71 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Action: 'create', calling method: .version_select at 0x7f5ed2ce89d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-645235293", "metadata": {"Type": "work"}}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ca30632-42c0-4fa4-bef8-05de4ee9ed71 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 118 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:31:01.087572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-645235293", "metadata": {"Type": "work"}}} Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: Aug 23 22:31:01.088575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-645235293', 'metadata': {'Type': 'work'}}}} Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi '' Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.089432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:31:01.090721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:31:01.091777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:31:01.091777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.091777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ca30632-42c0-4fa4-bef8-05de4ee9ed71 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.093329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8ca30632-42c0-4fa4-bef8-05de4ee9ed71 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017723 Aug 23 22:31:01.093926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 3/5] 10.222.0.73 () {60 vars in 1156 bytes} [Tue Aug 23 22:31:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:31:01.108589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-206f55c7-cd56-4a2e-99b4-84ceef92bb48 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2dd09d0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.225368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f0911844-996f-471d-b1ad-bdd115f9d88c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 345 microversion: 2.1 time: 0.219910 Aug 23 22:31:01.226022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:01 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:01.232220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-681d88af-f0bd-4690-a182-3735ff07c1a8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Calling method '.version_select at 0x7f5ed2d4d9d0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.293170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-206f55c7-cd56-4a2e-99b4-84ceef92bb48 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 200 len: 353 microversion: 2.1 time: 0.198005 Aug 23 22:31:01.293878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:01 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:01.398391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-681d88af-f0bd-4690-a182-3735ff07c1a8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] HTTP exception thrown: Volume tempest-invalid-87392435 could not be found. Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-681d88af-f0bd-4690-a182-3735ff07c1a8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-87392435 HTTP/1.1 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:01.423041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Volume tempest-invalid-87392435 could not be found. Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'tempest-invalid-87392435'} Aug 23 22:31:01.424201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-87392435 could not be found. (HTTP 404) (Request-ID: req-56f3f0ee-463e-43c1-b1a1-e3ed524cdc56) Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.424935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:01.426139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-87392435 could not be found. Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:01.427242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-87392435 could not be found. Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-87392435 could not be found. Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-681d88af-f0bd-4690-a182-3735ff07c1a8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 404 to user: Volume tempest-invalid-87392435 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-681d88af-f0bd-4690-a182-3735ff07c1a8 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-87392435" status: 404 len: 97 microversion: 2.1 time: 0.178562 Aug 23 22:31:01.428366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1212 bytes} [Tue Aug 23 22:31:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-87392435 => generated 97 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 22:31:01.429183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-06a378f1-a61d-4300-a0c8-c7dfb8b7f79c tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004034 Aug 23 22:31:01.429183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 5/9] 10.222.0.73 () {58 vars in 1140 bytes} [Tue Aug 23 22:31:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 22:31:01.444450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c68719f2-3c3e-472e-9efd-602fbfad6d6a tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013545 Aug 23 22:31:01.445706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 5/10] 10.222.0.73 () {58 vars in 1137 bytes} [Tue Aug 23 22:31:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 22:31:01.456084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-54d6aa8b-be63-458a-9ab7-87fb9430d8f6 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Calling method '.version_select at 0x7f5ed2d009d0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.508920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-54d6aa8b-be63-458a-9ab7-87fb9430d8f6 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] HTTP exception thrown: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-54d6aa8b-be63-458a-9ab7-87fb9430d8f6 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/os-volumes/f2a5b77f-7a64-45ad-8042-d882050da5e3 HTTP/1.1 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:31:01.512667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'f2a5b77f-7a64-45ad-8042-d882050da5e3'} Aug 23 22:31:01.513997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. (HTTP 404) (Request-ID: req-3957eea0-c0ac-4c1e-9dfd-481fa28ca872) Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:01.520233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:31:01.521573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-54d6aa8b-be63-458a-9ab7-87fb9430d8f6 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 404 to user: Volume f2a5b77f-7a64-45ad-8042-d882050da5e3 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-54d6aa8b-be63-458a-9ab7-87fb9430d8f6 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/f2a5b77f-7a64-45ad-8042-d882050da5e3" status: 404 len: 109 microversion: 2.1 time: 0.063960 Aug 23 22:31:01.522523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 6/11] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:31:01 2022] DELETE /compute/v2.1/os-volumes/f2a5b77f-7a64-45ad-8042-d882050da5e3 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:01.532856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-29fda22f-169d-4b17-84ff-bb6f8f6aef12 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Calling method '.version_select at 0x7f5ed2d4daf0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.664003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-29fda22f-169d-4b17-84ff-bb6f8f6aef12 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] HTTP exception thrown: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-29fda22f-169d-4b17-84ff-bb6f8f6aef12 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Request method failure captured: Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/os-volumes/14a68004-09cf-4ae6-a0f2-5df453463de6 HTTP/1.1 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUgnLXlfS8l9shASLpelDmGIU8Yulu9DHbkVCCXm5N99Nd0sI8JhpeYFJbcHoYp3lM3M21cfAwcVy1Rv7cCxZ7QRObE6TjN5tLz3HXDVxzcFnFf7SrRkObU_cWJzz6rSWquNj_yAnCa-CJKtFtilyTaPNIJT1efjsKYqVdptVSjiUY Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:01.665980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/928b74ee78134ef2a30168fcbda51f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_928b74ee78134ef2a30168fcbda51f37", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 928b74ee78134ef2a30168fcbda51f37 Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesNegativeTest-1665432011 Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ca63244d301a4f61a31590383ded12b3 Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesNegativeTest-1665432011-project Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '14a68004-09cf-4ae6-a0f2-5df453463de6'} Aug 23 22:31:01.678550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. (HTTP 404) (Request-ID: req-76ad3bca-f4d3-420c-a3b8-f631e0cd34d6) Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.679651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:01.680699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:31:01.681727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-29fda22f-169d-4b17-84ff-bb6f8f6aef12 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] Returning 404 to user: Volume 14a68004-09cf-4ae6-a0f2-5df453463de6 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-29fda22f-169d-4b17-84ff-bb6f8f6aef12 tempest-VolumesNegativeTest-1665432011 tempest-VolumesNegativeTest-1665432011-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/14a68004-09cf-4ae6-a0f2-5df453463de6" status: 404 len: 109 microversion: 2.1 time: 0.146184 Aug 23 22:31:01.682766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:01 2022] GET /compute/v2.1/os-volumes/14a68004-09cf-4ae6-a0f2-5df453463de6 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:02.241839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b2937ad1-c300-42ee-9ea0-c7c51762dccc tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2ce8af0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:02.307044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e9280076-1747-4c0c-b78a-9df76097d9e6 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2cd2790>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:02.534725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b2937ad1-c300-42ee-9ea0-c7c51762dccc tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 345 microversion: 2.1 time: 0.298098 Aug 23 22:31:02.547952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:02 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 345 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:02.594823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e9280076-1747-4c0c-b78a-9df76097d9e6 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 200 len: 353 microversion: 2.1 time: 0.291560 Aug 23 22:31:02.595391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 7/14] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:02 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 353 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:03.550555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-507312c7-c782-4fb5-a26d-b9c1c6cada6c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2cada60>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:03.610702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cdf49fd2-1f97-407a-ac7a-410bbca5c9b4 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2d4db80>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:03.720656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cdf49fd2-1f97-407a-ac7a-410bbca5c9b4 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 200 len: 354 microversion: 2.1 time: 0.114627 Aug 23 22:31:03.721557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 8/15] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:03 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:03.735169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4ae6eb19-3947-40d3-ad3b-15b755ab5153 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2cd2280>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:03.742842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-507312c7-c782-4fb5-a26d-b9c1c6cada6c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 346 microversion: 2.1 time: 0.196236 Aug 23 22:31:03.743598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:03 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 346 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:03.758323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-338843f1-868a-4578-a76d-896b360cf125 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Action: 'create', calling method: .version_select at 0x7f5ed2d009d0>, body: {"snapshot": {"volume_id": "b6b045aa-dd2b-46b4-92f4-645897c83bdc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1871138511"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:03.847254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4ae6eb19-3947-40d3-ad3b-15b755ab5153 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 200 len: 354 microversion: 2.1 time: 0.115933 Aug 23 22:31:03.848033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 9/17] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:03 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:03.862453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e16c31fd-6c31-4b34-b2ab-4c954b0a6530 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2cd2670>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:04.442898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e16c31fd-6c31-4b34-b2ab-4c954b0a6530 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 202 len: 0 microversion: 2.1 time: 0.584687 Aug 23 22:31:04.446166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 10/18] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:31:03 2022] DELETE /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:31:04.459160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-909178dc-e545-4c9a-8a5c-b0cb5340b640 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2cd2c10>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:04.596625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-909178dc-e545-4c9a-8a5c-b0cb5340b640 tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 200 len: 353 microversion: 2.1 time: 0.142720 Aug 23 22:31:04.597770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 11/19] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:04 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:04.749258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-338843f1-868a-4578-a76d-896b360cf125 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.996286 Aug 23 22:31:04.749838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 9/20] 10.222.0.73 () {60 vars in 1162 bytes} [Tue Aug 23 22:31:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:04.764346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-353cb670-0c4a-4295-9dbf-1d0d47eed292 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2cd2430>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:04.861754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-353cb670-0c4a-4295-9dbf-1d0d47eed292 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.102791 Aug 23 22:31:04.863269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 12/21] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:04 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:04.887155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ef844571-d6b0-4c14-a1a2-7f25ef09daef tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d048b0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:04.992741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ef844571-d6b0-4c14-a1a2-7f25ef09daef tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121991 Aug 23 22:31:05.000333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 10/22] 10.222.0.73 () {58 vars in 1140 bytes} [Tue Aug 23 22:31:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:05.013636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9b3b6361-bb8e-4411-8829-a9372502a508 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d4dee0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:05.106696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9b3b6361-bb8e-4411-8829-a9372502a508 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.097608 Aug 23 22:31:05.108381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 13/23] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:05 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:05.616302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-08f53939-0bc5-4f3e-81b2-ca00e404851c tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Calling method '.version_select at 0x7f5ed2d04820>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:05.705852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-08f53939-0bc5-4f3e-81b2-ca00e404851c tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] HTTP exception thrown: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-08f53939-0bc5-4f3e-81b2-ca00e404851c tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Request method failure captured: Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b HTTP/1.1 Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUhf-StofpR1NWWW8qF5_S2qYXRRRbuo9jl4OoH0wxaKmkjyGBJ9eZ00ZBzYzT0eUS87spbNG5kiqgG3z310glLkA5TXhi1PME1AoFrXUFVeZAhIFx0V7G-5WLTqldk2I4EKZLpMbZ9_GU5BFHiNMuowHp8tzn3k4kXCNgKEWTMxZg Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 7694b0bc65c44bb3b32016a22088b36b Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesGetTestJSON-1143326398 Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:31:05.707899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7694b0bc65c44bb3b32016a22088b36b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7694b0bc65c44bb3b32016a22088b36b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7694b0bc65c44bb3b32016a22088b36b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7694b0bc65c44bb3b32016a22088b36b", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesGetTestJSON-1143326398 Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 7694b0bc65c44bb3b32016a22088b36b Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesGetTestJSON-1143326398 Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesGetTestJSON-1143326398-project Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 70bb89837b504764b43568a9b8a1abe0 Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesGetTestJSON-1143326398-project Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'de7a7048-2742-4e8c-b5b4-55992b8ad02b'} Aug 23 22:31:05.709397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. (HTTP 404) (Request-ID: req-04acf270-a5e4-463e-8465-311e6e4aad70) Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:05.710326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:05.711599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:31:05.712508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-08f53939-0bc5-4f3e-81b2-ca00e404851c tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] Returning 404 to user: Volume de7a7048-2742-4e8c-b5b4-55992b8ad02b could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-08f53939-0bc5-4f3e-81b2-ca00e404851c tempest-VolumesGetTestJSON-1143326398 tempest-VolumesGetTestJSON-1143326398-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b" status: 404 len: 109 microversion: 2.1 time: 0.104159 Aug 23 22:31:05.713726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:05 2022] GET /compute/v2.1/os-volumes/de7a7048-2742-4e8c-b5b4-55992b8ad02b => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:06.151553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa9f8330-ddda-46cd-bd7b-8318e767d632 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2ce11f0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:06.261826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa9f8330-ddda-46cd-bd7b-8318e767d632 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.143070 Aug 23 22:31:06.262702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:06 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:07.276064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d534ab78-baf5-4c48-975f-1c7c90fe195b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d005e0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:07.356719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d534ab78-baf5-4c48-975f-1c7c90fe195b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.085777 Aug 23 22:31:07.357442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 12/26] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:07 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:08.378975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3afd11f5-09a9-4276-a671-c195b71419ae tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d4df70>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:08.466067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3afd11f5-09a9-4276-a671-c195b71419ae tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.090763 Aug 23 22:31:08.466775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 15/27] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:08 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:09.480752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a97b665c-d03a-4c8a-94a9-12a84a97ac82 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d04820>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:09.559885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a97b665c-d03a-4c8a-94a9-12a84a97ac82 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.083914 Aug 23 22:31:09.562438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 13/28] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:09 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:10.575513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6068d412-8ffc-424a-a63d-7d42fe3f199e tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2cd2160>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:10.643645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6068d412-8ffc-424a-a63d-7d42fe3f199e tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.073644 Aug 23 22:31:10.649376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 16/29] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:10 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:11.658058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ca3608cc-570c-4ab0-a6d2-43c97a4e5cf3 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d049d0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:11.777138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ca3608cc-570c-4ab0-a6d2-43c97a4e5cf3 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.122916 Aug 23 22:31:11.779617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 14/30] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:11 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:12.422308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-95557584", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "networks": [{"uuid": "bdbf1b83-de11-4249-938e-4a56298a80e8"}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:12.609117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] validate_networks() for [('bdbf1b83-de11-4249-938e-4a56298a80e8', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:13.038432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8bca9319-cc6b-4e14-b2e5-a681038ca6d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'create', calling method: .version_select at 0x7f5ed2d001f0>, body: {"keypair": {"name": "tempest-keypair-870452215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ512byO65a8ihRvTbtgh0TBKUNFE9hcdHI9lRPGdkpKqdYBZJUuRCTUJlKeqX72WL+e2Ck9FiCBr+qiItZ2rYXwcHFaXDp3RwAdM7CDEblhNa5CT9YwOPwtXA6g6cnM6g=="}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:13.111332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-8bca9319-cc6b-4e14-b2e5-a681038ca6d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:13.119106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-8bca9319-cc6b-4e14-b2e5-a681038ca6d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for user 2ca578d6a1374212a4f1476335c641b3 and project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:13.290697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8bca9319-cc6b-4e14-b2e5-a681038ca6d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.585200 Aug 23 22:31:13.291509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 15/31] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 22:31:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:13.297979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6112ee97-a082-4e07-8c8f-fd5225cc6e55 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2ca1f70>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:13.457843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6112ee97-a082-4e07-8c8f-fd5225cc6e55 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 288 microversion: 2.1 time: 0.163072 Aug 23 22:31:13.458803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 16/32] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:13 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 288 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:13.470860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d696fb4b-e81c-433b-87f6-1d65f12bf67d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2c5c700>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:13.863353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d696fb4b-e81c-433b-87f6-1d65f12bf67d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 202 len: 0 microversion: 2.1 time: 0.397099 Aug 23 22:31:13.864557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 17/33] 10.222.0.73 () {58 vars in 1254 bytes} [Tue Aug 23 22:31:13 2022] DELETE /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:31:13.875036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cebbd1a8-226c-47a4-a382-bdd304e5db4f tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2c5cdc0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:14.078301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cebbd1a8-226c-47a4-a382-bdd304e5db4f tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 200 len: 287 microversion: 2.1 time: 0.206897 Aug 23 22:31:14.084720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 18/34] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:13 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:14.887237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:14.887723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:14.888131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:14.888540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:14.889165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:14.931061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:14.931831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:14.935322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:14.936380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:14.937037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:14.937644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:15.021527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Getting quotas for project 5882c9c6cf794b3ab17230304c169f07. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:15.024958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1589033312", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:15.040434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Getting quotas for user 1c7b02646d0d499b8928aed95f10e9ac and project 5882c9c6cf794b3ab17230304c169f07. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:15.074984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:15.078737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:15.166851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] validate_networks() for [('604e815b-4af0-46a7-bceb-7b7ccb3f41e0', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:15.347464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1a62df87-1538-4b10-ab9e-986ae769b2e4 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.127457 Aug 23 22:31:15.350645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 17/35] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:31:15.367799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce294771-854a-49df-830f-0e8aafbbcbaf tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed2bdc670>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:15.441422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce294771-854a-49df-830f-0e8aafbbcbaf tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/9619f8f2-e07e-43fe-9abf-239602e89313" status: 200 len: 351 microversion: 2.1 time: 0.088270 Aug 23 22:31:15.441422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 18/36] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:15 2022] GET /compute/v2.1/os-volumes/9619f8f2-e07e-43fe-9abf-239602e89313 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:15.454731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14b74748-f06b-4922-a5b2-efef19af8c4c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2bdcdc0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:15.683109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-14b74748-f06b-4922-a5b2-efef19af8c4c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] HTTP exception thrown: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14b74748-f06b-4922-a5b2-efef19af8c4c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Request method failure captured: Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 HTTP/1.1 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUhNb94Ukg4Ut8wOUeIq_UKN_InT-H7FXG90ODG3mEJ6XQOtm8II61IFQYWNCDQ67-Qld2ob1voUAo6Hmot2ECnYGgNKtMKgxXgEk7jayN58XtDOn3T7ppCrQ-EWNbRIeoPeEw5K06zQ3T7h6AIMRLIfIWVD9bFbfiNjP8Mj7xeVXQ Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:15.686227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9246005ab3b64f3db9fdf644a0b8be02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ee9f51ba0353486b8c978aa3a84f01e2 Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '77b2713f-7365-4505-9b6c-c4f51cb57973'} Aug 23 22:31:15.687659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. (HTTP 404) (Request-ID: req-257950a4-aaa3-4996-8ba8-0e6a5f5c4a30) Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.692655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:15.693825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 22:31:15.694772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14b74748-f06b-4922-a5b2-efef19af8c4c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Returning 404 to user: Snapshot 77b2713f-7365-4505-9b6c-c4f51cb57973 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:15.695754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-14b74748-f06b-4922-a5b2-efef19af8c4c tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973" status: 404 len: 111 microversion: 2.1 time: 0.245462 Aug 23 22:31:15.696439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 19/37] 10.222.0.73 () {58 vars in 1251 bytes} [Tue Aug 23 22:31:15 2022] GET /compute/v2.1/os-snapshots/77b2713f-7365-4505-9b6c-c4f51cb57973 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:15.705113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f3e4c701-1b7b-4fe3-aa89-aeeb7838da72 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:15.708728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f3e4c701-1b7b-4fe3-aa89-aeeb7838da72 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:16.085005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f3e4c701-1b7b-4fe3-aa89-aeeb7838da72 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:16.128846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f3e4c701-1b7b-4fe3-aa89-aeeb7838da72 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1213 microversion: 2.1 time: 0.435184 Aug 23 22:31:16.130695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 20/38] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:15 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1213 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:16.147248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-238348c8-0b3e-4546-8798-84f663eb6d89 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2ce1040>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:16.598044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:16.598583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:16.599099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:16.599611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:16.600052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:16.620345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.626951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.629902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.631021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.631746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.632508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.651437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-238348c8-0b3e-4546-8798-84f663eb6d89 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 202 len: 0 microversion: 2.1 time: 0.512743 Aug 23 22:31:16.652535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 21/39] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:31:16 2022] DELETE /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:31:16.660430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca6d0f7a-c2ad-419d-9cec-9ccc20e6bc29 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed1b675e0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:16.677352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:16.695024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for user ebbf49534a8f41109f51637307270016 and project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:16.736785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:16.740254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:16.744022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca6d0f7a-c2ad-419d-9cec-9ccc20e6bc29 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 345 microversion: 2.1 time: 0.087463 Aug 23 22:31:16.745351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 22/40] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:16 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:17.029720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ce1438e4-427f-4e20-8606-690d91195cf3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.539143 Aug 23 22:31:17.031019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 19/41] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:31:17.043902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-96f98fb4-6d3c-4a45-8560-a7e4f26f6d10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.044830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-96f98fb4-6d3c-4a45-8560-a7e4f26f6d10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:17.155364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a4b1f9ed-4c73-41c0-9aca-499c7c6a3fbe tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.155476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a4b1f9ed-4c73-41c0-9aca-499c7c6a3fbe tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:17.252294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-96f98fb4-6d3c-4a45-8560-a7e4f26f6d10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:17.264671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-96f98fb4-6d3c-4a45-8560-a7e4f26f6d10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1222 microversion: 2.1 time: 0.225077 Aug 23 22:31:17.265685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 23/42] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:17 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:17.385308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a4b1f9ed-4c73-41c0-9aca-499c7c6a3fbe tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:17.413782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a4b1f9ed-4c73-41c0-9aca-499c7c6a3fbe tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1213 microversion: 2.1 time: 0.265472 Aug 23 22:31:17.417449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 20/43] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:17 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:17.526513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1038224397", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:17.641703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] validate_networks() for [('604e815b-4af0-46a7-bceb-7b7ccb3f41e0', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:17.768515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-21efe249-9838-4895-961a-b2c8a42918be tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed2d005e0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.863817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-21efe249-9838-4895-961a-b2c8a42918be tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 345 microversion: 2.1 time: 0.106462 Aug 23 22:31:17.864797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 21/44] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:17 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:18.456238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-341e9fc9-e77f-4dd0-b788-ef5ec67c10e2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:18.456238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-341e9fc9-e77f-4dd0-b788-ef5ec67c10e2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:18.496813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-341e9fc9-e77f-4dd0-b788-ef5ec67c10e2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:18.506210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-341e9fc9-e77f-4dd0-b788-ef5ec67c10e2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1213 microversion: 2.1 time: 0.068306 Aug 23 22:31:18.529656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 22/45] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:18 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:18.543195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:18.545477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:18.545477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:18.545477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:18.546007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:18.568056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:18.568567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:18.569037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:18.569769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:18.570227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:18.570649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:18.589724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:18.593825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for user ebbf49534a8f41109f51637307270016 and project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:18.609762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:18.612124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:18.793912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-395210144", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d6d93fc-f557-45a9-8e7c-c7d67b014366"}], "security_groups": [{"name": "tempest-securitygroup--1591392245"}], "key_name": "tempest-keypair-870452215", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:18.882795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f4b63951-fd23-44e6-a365-5cc3b6bb83e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.350102 Aug 23 22:31:18.882795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:31:18.891151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-29294bf4-fc02-4336-bebf-ffade4629e91 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:18.893319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-29294bf4-fc02-4336-bebf-ffade4629e91 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:18.996887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-29294bf4-fc02-4336-bebf-ffade4629e91 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:19.017298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-29294bf4-fc02-4336-bebf-ffade4629e91 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1222 microversion: 2.1 time: 0.135565 Aug 23 22:31:19.023650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 25/47] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:18 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:19.076996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5750a0c7-edee-4d7a-b14d-0bcc9e51fa35 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed1b67ca0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:19.182858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] validate_networks() for [('9d6d93fc-f557-45a9-8e7c-c7d67b014366', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:19.281987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5750a0c7-edee-4d7a-b14d-0bcc9e51fa35 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 200 len: 345 microversion: 2.1 time: 0.241399 Aug 23 22:31:19.282745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 26/48] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:19 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 345 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:19.533461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:19.535193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:19.543400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:19.545253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:19.545917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:19.547266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:19.547745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:19.548180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:19.806305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:19.826809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0bc28d5-f9e9-45fa-a88b-8676db6bcae7 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1209 microversion: 2.1 time: 0.297270 Aug 23 22:31:19.828370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 27/49] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:19 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1209 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:19.834902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-43a8d556-cd92-4ea0-9aff-ab44b80d25b8 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1b07e50>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:19.973345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-43a8d556-cd92-4ea0-9aff-ab44b80d25b8 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/a38d2835-529b-4f1e-b86f-5f0f601c70ea" status: 200 len: 351 microversion: 2.1 time: 0.143421 Aug 23 22:31:19.973977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 28/50] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:19 2022] GET /compute/v2.1/os-volumes/a38d2835-529b-4f1e-b86f-5f0f601c70ea => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:20.049205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9c37de26-5bed-4ac0-8721-b1994f681ab1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.050761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9c37de26-5bed-4ac0-8721-b1994f681ab1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:20.193761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c37de26-5bed-4ac0-8721-b1994f681ab1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:20.204895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9c37de26-5bed-4ac0-8721-b1994f681ab1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1222 microversion: 2.1 time: 0.162800 Aug 23 22:31:20.221098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 29/51] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:20.265968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:20.266527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:20.266861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:20.267275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:20.267695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:20.279634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.288184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.288184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.288184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.288184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.288563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.296361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e62ff08-3013-41ee-8409-02c9ecfda890 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed1b233a0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.334406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:20.340808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for user 2ca578d6a1374212a4f1476335c641b3 and project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:20.358268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:20.361440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:20.412826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-6e62ff08-3013-41ee-8409-02c9ecfda890 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] HTTP exception thrown: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e62ff08-3013-41ee-8409-02c9ecfda890 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Request method failure captured: Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc HTTP/1.1 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUhNb94Ukg4Ut8wOUeIq_UKN_InT-H7FXG90ODG3mEJ6XQOtm8II61IFQYWNCDQ67-Qld2ob1voUAo6Hmot2ECnYGgNKtMKgxXgEk7jayN58XtDOn3T7ppCrQ-EWNbRIeoPeEw5K06zQ3T7h6AIMRLIfIWVD9bFbfiNjP8Mj7xeVXQ Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:20.415127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9246005ab3b64f3db9fdf644a0b8be02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ee9f51ba0353486b8c978aa3a84f01e2 Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'b6b045aa-dd2b-46b4-92f4-645897c83bdc'} Aug 23 22:31:20.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. (HTTP 404) (Request-ID: req-dda9a16a-074a-455c-9a18-c28d72ceb673) Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.424063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:20.425831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:31:20.426780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e62ff08-3013-41ee-8409-02c9ecfda890 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Returning 404 to user: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e62ff08-3013-41ee-8409-02c9ecfda890 tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 404 len: 109 microversion: 2.1 time: 0.124519 Aug 23 22:31:20.427727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 30/52] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:20.438434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c877dc93-95ad-4f2f-b801-1cdd9d5e130d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed1b15c10>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.479728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-c877dc93-95ad-4f2f-b801-1cdd9d5e130d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] HTTP exception thrown: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c877dc93-95ad-4f2f-b801-1cdd9d5e130d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Request method failure captured: Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc HTTP/1.1 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUhNb94Ukg4Ut8wOUeIq_UKN_InT-H7FXG90ODG3mEJ6XQOtm8II61IFQYWNCDQ67-Qld2ob1voUAo6Hmot2ECnYGgNKtMKgxXgEk7jayN58XtDOn3T7ppCrQ-EWNbRIeoPeEw5K06zQ3T7h6AIMRLIfIWVD9bFbfiNjP8Mj7xeVXQ Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:20.481568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9246005ab3b64f3db9fdf644a0b8be02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ee9f51ba0353486b8c978aa3a84f01e2 Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'b6b045aa-dd2b-46b4-92f4-645897c83bdc'} Aug 23 22:31:20.482655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. (HTTP 404) (Request-ID: req-7c19a8d6-085e-4baf-97e0-5df29d500a09) Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.483324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:31:20.484624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:31:20.485780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c877dc93-95ad-4f2f-b801-1cdd9d5e130d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Returning 404 to user: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c877dc93-95ad-4f2f-b801-1cdd9d5e130d tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 404 len: 109 microversion: 2.1 time: 0.052896 Aug 23 22:31:20.487012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 31/53] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:31:20 2022] DELETE /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:20.508196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6629afbc-1d1a-404f-830d-cdea49e59f6b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Calling method '.version_select at 0x7f5ed1b15f70>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.535967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-24104d19-e040-4d81-91ee-facd74688b2d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.743156 Aug 23 22:31:20.538427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 23/54] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:31:20.549312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aaaacbf7-871d-402e-abb1-bd3f7088f0d4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.553068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aaaacbf7-871d-402e-abb1-bd3f7088f0d4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:20.723754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-6629afbc-1d1a-404f-830d-cdea49e59f6b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] HTTP exception thrown: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6629afbc-1d1a-404f-830d-cdea49e59f6b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Request method failure captured: Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc HTTP/1.1 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUhNb94Ukg4Ut8wOUeIq_UKN_InT-H7FXG90ODG3mEJ6XQOtm8II61IFQYWNCDQ67-Qld2ob1voUAo6Hmot2ECnYGgNKtMKgxXgEk7jayN58XtDOn3T7ppCrQ-EWNbRIeoPeEw5K06zQ3T7h6AIMRLIfIWVD9bFbfiNjP8Mj7xeVXQ Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:31:20.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9246005ab3b64f3db9fdf644a0b8be02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9246005ab3b64f3db9fdf644a0b8be02", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9246005ab3b64f3db9fdf644a0b8be02 Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2069760040 Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ee9f51ba0353486b8c978aa3a84f01e2 Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2069760040-project Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'b6b045aa-dd2b-46b4-92f4-645897c83bdc'} Aug 23 22:31:20.727307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. (HTTP 404) (Request-ID: req-0da82cd0-e7c3-4c8f-9605-ba50e8aa567f) Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.728479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:31:20.729737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:31:20.730907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:31:20.732101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6629afbc-1d1a-404f-830d-cdea49e59f6b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] Returning 404 to user: Volume b6b045aa-dd2b-46b4-92f4-645897c83bdc could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:20.734489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6629afbc-1d1a-404f-830d-cdea49e59f6b tempest-VolumesSnapshotsTestJSON-2069760040 tempest-VolumesSnapshotsTestJSON-2069760040-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc" status: 404 len: 109 microversion: 2.1 time: 0.243747 Aug 23 22:31:20.734805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 32/55] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/os-volumes/b6b045aa-dd2b-46b4-92f4-645897c83bdc => generated 109 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:20.863805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.865140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:20.877730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.882190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.883478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.886115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.888382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.890470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.899562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aaaacbf7-871d-402e-abb1-bd3f7088f0d4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:20.911194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aaaacbf7-871d-402e-abb1-bd3f7088f0d4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1236 microversion: 2.1 time: 0.365926 Aug 23 22:31:20.911765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 24/56] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1236 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:21.152732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:21.175822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d7b7bcb2-5e9d-477d-b792-7d0b8df43709 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1265 microversion: 2.1 time: 0.319080 Aug 23 22:31:21.177133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 33/57] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:21.234155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.234822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:21.250564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.251332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.253393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.254626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.269188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.288943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.706632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:21.735520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b657d204-fb07-40c3-8c14-e83782fa4cd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1226 microversion: 2.1 time: 0.505614 Aug 23 22:31:21.739907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 25/58] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1226 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:21.946813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2568bd86-4a75-4886-a7a3-5a1d28be94fa tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.946813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2568bd86-4a75-4886-a7a3-5a1d28be94fa tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:22.024076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2568bd86-4a75-4886-a7a3-5a1d28be94fa tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:22.031073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2568bd86-4a75-4886-a7a3-5a1d28be94fa tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1236 microversion: 2.1 time: 0.097867 Aug 23 22:31:22.031649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 34/59] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:22.196224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:22.196933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:22.219696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.220762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.222087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.226613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.226613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.226613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.373664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:22.387221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fbe70d92-d8c6-47e1-afb8-41217d1f5468 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1271 microversion: 2.1 time: 0.195074 Aug 23 22:31:22.388436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 26/60] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:22 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:22.760723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:22.761755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:22.783341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.785098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.786006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.787272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.788043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.788875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.884179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:22.897768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dde3dc6e-1b65-439f-8f10-ad6d3096381f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1274 microversion: 2.1 time: 0.140099 Aug 23 22:31:22.899049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 35/61] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:22 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:23.053318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:23.054344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:23.061674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.062509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.064376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.066650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.067302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.068163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.215614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b9cec444-01d1-4ab9-9727-8b32f84f962d tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1ac9ee0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:23.216169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:23.226520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-82f0a7d4-5f08-43a6-89b5-9ca107960860 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1240 microversion: 2.1 time: 0.178455 Aug 23 22:31:23.227106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 27/62] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1240 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:23.411082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:23.411828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:23.420575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.421072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.427777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.466328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.466328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.466595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b9cec444-01d1-4ab9-9727-8b32f84f962d tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/1169b7a2-4cab-43ee-bfbe-773fe822f473" status: 200 len: 351 microversion: 2.1 time: 0.224153 Aug 23 22:31:23.466694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.466783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 36/63] 10.222.0.73 () {58 vars in 1245 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/os-volumes/1169b7a2-4cab-43ee-bfbe-773fe822f473 => generated 351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:23.476141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9270b6e-b818-4007-90a6-0dbffec8461b tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1b15700>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:23.836820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9270b6e-b818-4007-90a6-0dbffec8461b tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.366752 Aug 23 22:31:23.840038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 37/64] 10.222.0.73 () {58 vars in 1134 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:23.853962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-085e3747-92cc-4ce1-94e1-7774a0cc1cff tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1a6ae50>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.223608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-085e3747-92cc-4ce1-94e1-7774a0cc1cff tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.373620 Aug 23 22:31:24.224638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 38/65] 10.222.0.73 () {58 vars in 1149 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:24.229673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.235528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:24.257546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.261735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.263421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:24.264482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.265108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.265724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:24.401940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:24.402679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:24.410732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2040510b-089a-4362-a798-e208cb278283 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1280 microversion: 2.1 time: 0.184961 Aug 23 22:31:24.415128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 39/66] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:24.423654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c405a996-cba7-49f6-b2a9-e97672a165e6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 1.017427 Aug 23 22:31:24.427000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 28/67] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:24.443527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.446419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:24.447964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a09d2885-81e2-4aa2-a3c3-9ed6b812f04a tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1a6aa60>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.464991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.472695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.475797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:24.476810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.477328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.478061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:24.638936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a09d2885-81e2-4aa2-a3c3-9ed6b812f04a tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.222275 Aug 23 22:31:24.639739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 40/68] 10.222.0.73 () {58 vars in 1134 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:24.653403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ff16fe9-96a9-40f2-8f42-c246daa71c66 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1b1f9d0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.848405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ff16fe9-96a9-40f2-8f42-c246daa71c66 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.198516 Aug 23 22:31:24.849002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 41/69] 10.222.0.73 () {58 vars in 1167 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:24.866417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-301f116c-f3da-4f38-a25f-0566a0182b19 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1adfb80>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.009327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-301f116c-f3da-4f38-a25f-0566a0182b19 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.146937 Aug 23 22:31:25.010562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 42/70] 10.222.0.73 () {58 vars in 1170 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:25.042490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb909176-b3e1-4445-a888-261c8394ba35 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1ac9040>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.048761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:25.066772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-db2fd5a8-1bda-4e22-85ef-74f1f10d7f07 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1288 microversion: 2.1 time: 0.633147 Aug 23 22:31:25.066772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 29/71] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1288 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:25.306908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb909176-b3e1-4445-a888-261c8394ba35 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.276633 Aug 23 22:31:25.307783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 43/72] 10.222.0.73 () {58 vars in 1155 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:25.321694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-86e4231b-adfa-4310-ba9f-967e3e6353b8 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed12bb5e0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.435877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.436490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:25.447115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.447623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.449649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.450762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.452995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.457822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.490449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-86e4231b-adfa-4310-ba9f-967e3e6353b8 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.173011 Aug 23 22:31:25.491532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 30/73] 10.222.0.73 () {58 vars in 1188 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:25.504101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.504967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:25.541457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.543144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.544096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.545798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.550794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.551506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.610427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:25.621392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f75392ea-ce84-4349-91a6-265d3e3c08fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1280 microversion: 2.1 time: 0.189355 Aug 23 22:31:25.622499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 44/74] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:25.635955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-439abeb7-d798-4318-bc20-7af66efd0644 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] Calling method '.version_select at 0x7f5ed1ac9040>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.740609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:25.744435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-439abeb7-d798-4318-bc20-7af66efd0644 tempest-VolumesTestJSON-868584156 tempest-VolumesTestJSON-868584156-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.120726 Aug 23 22:31:25.758115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 45/75] 10.222.0.73 () {58 vars in 1155 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:25.767577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1ee4c67-0910-4a22-9dce-33895d50e236 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.274587 Aug 23 22:31:25.781751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 31/76] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:26.087846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:26.088475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:26.099419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.107031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.108240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.113834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.114361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.119935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.337402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:26.347618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f80fac54-91da-466f-9bce-69ffb6e9667a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1296 microversion: 2.1 time: 0.264018 Aug 23 22:31:26.361400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 46/77] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:26 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1296 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:26.658824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:26.659797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:26.684678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.684678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.684678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.684678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.685271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.685271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.794692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:26.795492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:26.808236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.808742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.813376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.814182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.814671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.815679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.057046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.081819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6131f1f9-a796-465a-9515-d239c6012129 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1280 microversion: 2.1 time: 0.427836 Aug 23 22:31:27.086747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 32/78] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:26 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1280 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:27.375041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:27.376085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:27.394171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.397863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.399056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.401212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.401842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.405621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.680800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.700217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-51dd097f-8a65-46e7-bad0-ed797b342139 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.913616 Aug 23 22:31:27.706811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 47/79] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:26 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:27.770145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.810194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a052b20-7286-464b-a3f5-259aeedc5fa7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1294 microversion: 2.1 time: 0.434539 Aug 23 22:31:27.820143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 33/80] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:27 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1294 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:28.069281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1", "tag": "60eabd9e-c078-4535-8434-ce6f397ae447"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:28.090371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.090866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.091577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.105090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:28.106273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:28.119624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.120492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.125133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.126857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.131456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.133720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.139784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Creating event network-changed:60eabd9e-c078-4535-8434-ce6f397ae447 for instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 on hv-cinder-84254 Aug 23 22:31:28.141773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 22:31:28.149765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dc7a6455-93b5-4e40-b933-e20ce6030df5 req-881bbc65-f9fc-4f93-a55e-2f229d37ab99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 22:31:28.149765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.149765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.149765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.149765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.151239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.151239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.172619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.compute.rpcapi [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 22:31:28.178046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] Releasing lock "compute-rpcapi-router" {{(pid=121885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 22:31:28.241939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-99ab4df7-b551-4e55-b50c-e8da4e791e7f None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532055 Aug 23 22:31:28.245271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 48/81] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:28.761919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:28.763396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:28.773985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.774787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.775402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.776402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.777159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.778021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.024197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.061513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-376af157-c283-407d-afbe-ead779e3b9a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.961741 Aug 23 22:31:29.081318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 34/82] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:28 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:29.087380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:29.091717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:29.117527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.118295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.118876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.119753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.120350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.120917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.295707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.315737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-978fffca-4faa-4db4-899c-129e270be681 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1294 microversion: 2.1 time: 0.232399 Aug 23 22:31:29.329040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 35/83] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:29 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:29.402177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.446594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-edff0775-b9a3-4778-ac55-0e61f8b38ea0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.677495 Aug 23 22:31:29.447513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 49/84] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:28 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:30.125024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.125024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.125024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.125024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.130152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.130152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.130152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.130152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.302190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba92e33-0332-41e6-8ae0-edb3db94d4e6", "tag": "b80c9e2b-7745-482f-981d-a9d71d3f76ad"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:30.313579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=4 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:30.328497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.337127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.337609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.364399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] Creating event network-changed:b80c9e2b-7745-482f-981d-a9d71d3f76ad for instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 on hv-cinder-84254 Aug 23 22:31:30.382365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-1b848320-f251-481d-b986-ad0f1c0c8e15 req-051c799e-bb7e-43ba-83a9-088558933bdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086024 Aug 23 22:31:30.386119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 50/85] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:30.399786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.400737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.412821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.412821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.413402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.413895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.414355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.414833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.427700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.439566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a2678aa-0311-4dfe-bf5d-1f596c42e275 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.359092 Aug 23 22:31:30.456173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 36/86] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:30.490329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.491571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.532578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.543105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.543105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.543105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.543105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.543428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.907686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=22 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:30.989922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:31.005769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9937aa21-1040-4274-afa3-69d47a073f92 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.617861 Aug 23 22:31:31.025835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:31.026026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 51/87] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:31.040094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f7c9379-5546-446e-80de-b4f72a35f372 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.569066 Aug 23 22:31:31.041348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 37/88] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:31.465526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:31.467832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:31.480617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.484080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.487564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.488773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.490539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.491214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.794337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:31.816016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6c8233c0-210a-44a5-9b1f-26e5deffbef4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.354006 Aug 23 22:31:31.818778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 38/89] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:31 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:32.029074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=22 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:32.036010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.036985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.070395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.073275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.074097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.075289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.086184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.089175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.362648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5efd28-1582-46ac-b8b3-5a2c48232b38", "tag": "5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:32.440016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.448683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.453182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.506636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] Creating event network-changed:5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d for instance be5efd28-1582-46ac-b8b3-5a2c48232b38 on hv-cinder-84254 Aug 23 22:31:32.531943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-63a29388-fb9f-42b8-8a8a-814c1b934a47 req-c35b1c89-afae-4b78-9639-57424d079371 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.111598 Aug 23 22:31:32.534613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 52/90] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:32.553723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.589798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.615768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.617035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.626011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.629612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.634128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.636944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.846773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:32.857330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7632da18-f379-4018-9748-f17913c9f8fb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.831627 Aug 23 22:31:32.858242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 39/91] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:32.871769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.873404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.888604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.889357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.890954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.891800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.892267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.892698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.274321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.301800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.305045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fada3bea-3f43-4c23-ad85-14d54ae44b12 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.768053 Aug 23 22:31:33.317752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2592dd65-a2ed-4308-9c34-14b2ca13efd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.458122 Aug 23 22:31:33.318808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 40/92] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:33.322235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 53/93] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:33.882209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:33.883852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:33.893986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.894981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.895618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.897163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.897827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.898477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.425490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:34.425490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:34.425490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.425490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.427207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.427207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.427207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.427207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.472031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.486025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:34.508189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fc6991ca-a274-4d78-ac3c-87a8fd96ba18 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.630500 Aug 23 22:31:34.516301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 41/94] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:33 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:34.548456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:34.550938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:34.605899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.608162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.609703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.611385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.613578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.617892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.865543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.874269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5b404bd5-7d41-436f-bd97-62b9b35814a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.525702 Aug 23 22:31:34.889817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 54/95] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:34 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:34.889817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8f6ad2-07f8-4f77-81d2-70e697b1e275", "tag": "56d68285-5ed7-44d0-af14-bbfdf7877de6"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:34.919938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.920608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.921233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.952868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] Creating event network-changed:56d68285-5ed7-44d0-af14-bbfdf7877de6 for instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 on hv-cinder-84254 Aug 23 22:31:34.961767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-216c68f4-9f75-4ea1-855e-29dafe74f7c5 req-02541c68-9514-4d92-8454-4f06ef398cdb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078212 Aug 23 22:31:34.966525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 55/96] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:35.011008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.021116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-88fa2993-06ae-4324-a4a2-74b8f92b9300 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.501235 Aug 23 22:31:35.022610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 42/97] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:34 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:35.544291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.545807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.559216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.559721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.560210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.560936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.561561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.562183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.788410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.798486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a6bd1023-ef36-4369-a7fd-956e27b38a78 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.257913 Aug 23 22:31:35.800053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 56/98] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:35.899691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.900311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.917312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.917312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.917312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.917312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.917868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.917868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.046912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:36.049740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:36.075501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.077127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.078126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.079363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.079993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.083972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.114444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:36.125044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31a7fbb7-40a0-48ae-a4be-0b817c72f052 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.227570 Aug 23 22:31:36.125657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 43/99] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:36.305320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:36.314549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-72351756-e39c-409a-ab82-02395b075a0a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.273812 Aug 23 22:31:36.324628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 57/100] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:36 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:36.820822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:36.821487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:36.829272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.829849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.830936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.831929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.832440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.832891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.977647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:36.986012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a8520cb7-0c39-4bf5-9312-b7d3986c4d0a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.169107 Aug 23 22:31:36.988112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 44/101] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:36 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:37.147513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:37.148156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:37.154349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.154740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.155167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.155856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.156302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.156716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.349563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:37.350246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:37.352989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:37.372863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.379029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.379029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.379029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.379029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.379367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.392367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:37.413348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b248cbc6-78ec-4525-8ac0-4572c470abfa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.269185 Aug 23 22:31:37.430875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 58/102] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:37 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:37.611108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:37.619711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7340e350-272c-4ee7-8e91-0c0bcba7993e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.275214 Aug 23 22:31:37.620290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 45/103] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:37 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:38.011343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:38.011343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:38.015004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.015486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.015921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.016661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.017139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.018720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.022827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:38.168628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:38.215260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.224451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4410d9aa-7250-4eb4-91e9-ac293487575a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.220047 Aug 23 22:31:38.225319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 59/104] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:38 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:38.439306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:38.440345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:38.446586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.447069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.447505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.448267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.448712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.449207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.613950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.621935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e4144922-4c5e-4694-bfad-0fef7060006e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.186821 Aug 23 22:31:38.626540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 46/105] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:38 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:38.641488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:38.642062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:38.644879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:38.650016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.650511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.650948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.651659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.652150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.652730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.794503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.803259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0f7225b-d1fc-4fa8-a90f-140a94aa28d8 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.165703 Aug 23 22:31:38.804030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 60/106] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:38 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:39.246738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.247351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.254229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.254684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.255122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.255819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.256421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.256709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.403001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.411797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-20d994d2-33ae-443e-8b0b-6f86acf7a416 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.169025 Aug 23 22:31:39.412393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 47/107] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:39.647073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.647688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.661665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.662253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.662695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.663433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.663886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.664491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.825780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.826992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.836464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.836965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.837468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.846873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.847388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.847839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.853159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.869259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ed27da73-810b-4b54-ae5c-665fb71f697b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.221742 Aug 23 22:31:39.869259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 61/108] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:40.014819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:40.023096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f576c562-7015-4f0c-acf9-08a0b5e13b44 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.201841 Aug 23 22:31:40.023789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 48/109] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:40.437589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:40.440573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:40.446861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:40.447355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:40.447792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:40.448493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:40.448945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:40.449391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:40.608821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:40.620077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9b746c7-9a29-45a3-b3a5-ef6633777d28 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.186635 Aug 23 22:31:40.620948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 62/110] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:40 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:40.887371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:40.887997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:40.894186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:40.894677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:40.895286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:40.896202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:40.896691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:40.897155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.041475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.048649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:41.049995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:41.050149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07d26f38-01f2-43f9-9b0a-59e6747cd968 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.165603 Aug 23 22:31:41.050896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 49/111] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:40 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:41.057000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.058040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.058548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.059362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.059911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.060416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.202187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.211195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2bc7c5c6-4183-4720-b292-708777d0fd6a tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.166594 Aug 23 22:31:41.211768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 63/112] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:41 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:41.644903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:41.645501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:41.651752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.652241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.652678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.653412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.653878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.654338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.800196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.810966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cda0514f-9e1a-4656-981f-004c8e41d00e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.170775 Aug 23 22:31:41.811817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 50/113] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:41 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:42.077535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:42.078048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:42.084155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.084649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.085187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.085963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.087478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.088077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.232650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:42.233373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:42.239946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.240608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.241058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.241760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.242203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.242448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:42.242616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.250465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d645f707-84e3-45b9-9be8-6483afd65918 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.182736 Aug 23 22:31:42.251586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 64/114] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:42 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:42.396173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:42.406037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a27eeffa-d148-4743-87e0-502fe83dc488 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.177601 Aug 23 22:31:42.409169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 51/115] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:42 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:42.843848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:42.844464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:42.852622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.853094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.853442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.854194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.854617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.855036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.042397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:43.042397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-75ecabcf-d311-4a7a-b345-7dbe3191b27a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.182459 Aug 23 22:31:43.042397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 65/116] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:42 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:43.279476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.279476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.289949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.290794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.291741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.293154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.294111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.294812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.428097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.429392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.440989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.440989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.440989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.440989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.441563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.441563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.467084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:43.479379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e33d8438-ea7e-4145-8545-aac7b108eb77 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.208502 Aug 23 22:31:43.479965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 52/117] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:43 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:43.622597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:43.631545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-930aa07d-263c-4421-9652-2735bf7ff2a6 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.208131 Aug 23 22:31:43.632126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 66/118] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:43 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:44.040599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:44.043087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:44.052552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.053408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.054167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.055337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.055928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.056472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.215716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.224852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6b0f5edc-36ba-47a8-b229-971905131b62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.191945 Aug 23 22:31:44.225467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 53/119] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:44 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:44.505412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:44.509137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:44.519035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.520083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.520841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.521805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.522460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.523303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.654493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:44.656311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:44.672145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.672810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.675683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.677785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:44.678666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:44.680720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.697415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.707600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-afcee302-3908-4ad0-b53e-b32fc00f1b48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.211527 Aug 23 22:31:44.722928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 67/120] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:44 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:44.856036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.870052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aa602495-b363-45e4-9cc1-36b4f82e363b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.222055 Aug 23 22:31:44.879780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 54/121] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:44 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:45.246699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:45.247678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:45.255305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.257555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.258276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.259355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.259959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.260532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.293669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1", "name": "network-vif-plugged", "status": "completed", "tag": "60eabd9e-c078-4535-8434-ce6f397ae447"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:45.304994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.305777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.306368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.318632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] Creating event network-vif-plugged:60eabd9e-c078-4535-8434-ce6f397ae447 for instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 on hv-cinder-84254 Aug 23 22:31:45.324035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-054b5445-7292-4a9f-8703-4f8993e3c1e5 req-68666141-876c-45c4-9fa1-98fa4a385dfb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199152 Aug 23 22:31:45.324884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 68/122] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:45.439002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:45.451184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5fd9e8fe-6e38-43e6-952f-dd7e1cf6169f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.208271 Aug 23 22:31:45.451184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 55/123] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:45 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:45.732000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:45.732705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:45.739799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.740304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.740733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.741653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.742149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.742577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.886877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:45.890630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:45.891270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:45.895708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-401c1839-b19b-480c-a920-db6c404be193 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.168077 Aug 23 22:31:45.896292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 69/124] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:45 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:45.898065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.898546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.898980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.899668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.900121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.900524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.030645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:46.038482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8b35fc3b-3289-4b4d-8b19-2a3fe9095441 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.151828 Aug 23 22:31:46.039058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 56/125] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:45 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:46.474837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:46.475450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:46.481871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.482361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.482802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.483523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.484000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.484431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.630569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:46.638334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0968ca6b-77cb-4790-b9a6-3d0ec3e18ab1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.168216 Aug 23 22:31:46.651654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 70/126] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:46 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:46.916996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:46.923262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:46.926710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.927083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.927520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.928442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.928899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.929370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.059569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:47.060190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:47.066830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.067354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.067766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.068877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.068877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.069346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.148820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.173671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ac8d9d3-20f9-467e-90de-6e4e0690e6cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.260386 Aug 23 22:31:47.175276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 57/127] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:46 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:47.212871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.222294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6b43b3fd-7f7c-46be-9f52-540a848af121 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.164795 Aug 23 22:31:47.222294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 71/128] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:47 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:47.659311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:47.659923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:47.666640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.667121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.673286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.674589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.675954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.676543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.696373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:47.815682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.823431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b82723c2-4457-44f5-8664-a8fea7e212c0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.168002 Aug 23 22:31:47.824041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 58/129] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:47 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:48.196259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.196873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.202895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.203376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.203816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.204568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.205040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.205475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.242098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.242810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.249152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.249631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.250066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.250815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.251265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.251687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.371988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:48.380954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-137312e3-67ed-4174-b419-0dfeaad1d909 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.188417 Aug 23 22:31:48.382046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 72/130] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:48 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:48.402701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:48.410721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bcbd66b1-401a-4308-a0f2-12cf667785b9 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.172416 Aug 23 22:31:48.411308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 59/131] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:48 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:48.845208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.845824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.852082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.852567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.853002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.853706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.854155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.854588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.985255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:48.993594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ec433b2c-b846-4893-bb1b-6d452cc56b15 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.151925 Aug 23 22:31:48.993949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 73/132] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:48 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:49.407421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:49.407421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:49.411489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.411966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.412389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.413110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.413560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.413975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.436429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:49.437727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:49.446616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.446616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.446616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.459662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.459662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.459662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.579672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.588691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e93fac33-34f0-45a5-b36d-a92e143d6557 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.190070 Aug 23 22:31:49.591301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 60/133] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:49 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:49.603791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.614574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1a34f91f-08d8-4251-beed-2676a825f0d2 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.182107 Aug 23 22:31:49.615690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 74/134] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:49 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:50.014868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:50.015586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:50.022601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.023177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.023619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.024360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.024839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.028164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.164847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.172706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fdea5694-1638-4cf2-8f40-3d6b15502a4d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.161554 Aug 23 22:31:50.173488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 61/135] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:50 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:50.611174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:50.612258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:50.623539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.623539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.623539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.623539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.623801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.623801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.635931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:50.639178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:50.642905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.644023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.644449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.645317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.645770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.646197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.842334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.852734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d578248e-2b94-4435-9caf-e7e8d4f0e99b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.245284 Aug 23 22:31:50.853374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 75/136] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:50 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:50.886040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.894373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02a159a3-6c45-421f-8572-3b03b8fbc1b3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.262780 Aug 23 22:31:50.895049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 62/137] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:50 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:51.234274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:51.234274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:51.234274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.234274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.235012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.235012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.235012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.235012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.235262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:51.339202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:51.346641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3d6a5559-e87e-4138-9d9b-a3499e8b93d1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.155421 Aug 23 22:31:51.351643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 76/138] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:51 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:51.873363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:51.874070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:51.881033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.881527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.881961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.882683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.883162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.883581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.916035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:51.916800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:51.923317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.923845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.924892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.925708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.926168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.926743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.071211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.079479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-596d26ad-2d6f-47c4-8689-e22e80cb6373 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.167335 Aug 23 22:31:52.080356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 77/139] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:51 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:52.086868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.094755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-48d2e498-d02a-459b-b9a0-d466eb2f3281 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.225272 Aug 23 22:31:52.095405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 63/140] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:51 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:52.367513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:52.368112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:52.374564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:52.375040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:52.375462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.376214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:52.376820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:52.377306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.507487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.515158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-65e000d0-34af-4afc-a9ee-1b50fae7bde1 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.151537 Aug 23 22:31:52.515713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 78/141] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:52 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:53.100856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.101927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:53.107925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.108380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.108816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.109560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.110016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.110827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.117291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.117854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:53.125153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.125640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.126736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.126925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.128018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.128506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.254065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.262809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78537f42-df69-43e3-b090-044e787df62c tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.165636 Aug 23 22:31:53.263721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.263845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 64/142] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:53 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:53.275552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dd82e80d-eebc-4512-9cb7-8a344e21ea40 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.163719 Aug 23 22:31:53.276286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 79/143] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:53 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:53.538212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.539162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:53.545127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.545616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.546045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.546729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.547174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.547590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.695399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.703216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-afe5badb-1557-4f3f-a9ee-1d398ff68992 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.169468 Aug 23 22:31:53.703795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 65/144] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:53 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:54.290764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:54.291406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:54.296423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:54.297870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:54.298192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.298891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.299525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.300470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.301304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.301880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.305830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.306626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.307465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.308648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.309312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.309929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.448506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.457404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9f54fd18-1fb3-4fae-8b66-d4764fb300fb tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.170771 Aug 23 22:31:54.458158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 80/145] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:54 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:54.461130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.470571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e1a0057-e85c-427a-a8d5-30949ae463f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.178173 Aug 23 22:31:54.471086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 66/146] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:54 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:54.725861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:54.725861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:54.731478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.731964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.732429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.733166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.733623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.734045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.879465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.894504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b447f1e6-aa12-4b4a-ab9f-c533364bf5d5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.174170 Aug 23 22:31:54.894988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 81/147] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:54 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:54.953691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5efd28-1582-46ac-b8b3-5a2c48232b38", "name": "network-vif-plugged", "status": "completed", "tag": "5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:54.967200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.967680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.968110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.998064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Creating event network-vif-plugged:5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d for instance be5efd28-1582-46ac-b8b3-5a2c48232b38 on hv-cinder-84254 Aug 23 22:31:54.998842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 22:31:54.999309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d6de2ce6-5b9a-432c-9066-37e31cec1489 req-9ba82592-a484-4c70-83e7-0386216ac700 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 22:31:55.000437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.000890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.001327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.002099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.006299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.006299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.019020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.compute.rpcapi [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 22:31:55.020204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=121884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 22:31:55.043788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6bcecec2-54d1-4829-bf32-78ffc314f5a2 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094192 Aug 23 22:31:55.044865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 67/148] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:55.478286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:55.480167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:55.484878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.485402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.485891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.487324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.487856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.488346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.496122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:55.496863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:55.503543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.504331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.504769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.505521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.506157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.506760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.655557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:55.667404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca64d6b7-dcec-404a-8a75-38f81d8e9748 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.193197 Aug 23 22:31:55.668022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 82/149] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:55 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:55.699051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:55.709728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-909ffb20-640f-4e3f-ab34-e2ef8f0d917d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.217799 Aug 23 22:31:55.710306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 68/150] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:55 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:55.915762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:55.916293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:55.922788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.923285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.923719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.924468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.924923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.925441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.063719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.071559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-19d27099-171a-4520-baff-0dcd53beee26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.159696 Aug 23 22:31:56.072123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 83/151] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:55 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:56.689149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:56.689805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:56.695843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:56.696332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:56.696760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.697477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:56.697919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:56.698338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.732028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:56.732636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:56.739060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:56.739631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:56.740085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.740766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:56.741241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:56.741669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.833452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.838045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cdca34d7-4c7a-42bd-a49c-49367720129f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.152569 Aug 23 22:31:56.839034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 69/152] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:56 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:56.877214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.884921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-18f7a715-f304-4d95-ab04-6ac1742653e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.156838 Aug 23 22:31:56.900446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 84/153] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:56 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:57.093419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.094032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.100286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.101496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.102037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.103053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.104248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.104829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.237588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:57.245931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5ba32c35-60d7-4b3b-98d1-cb43bce521fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.156392 Aug 23 22:31:57.246738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 70/154] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:57 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:57.859779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.860305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.866958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.867443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.867894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.868577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.869052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.869485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.919797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.920679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.927506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.927987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.928419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.929143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.929598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.930047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.010422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.020069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4456690a-dc93-4103-9a35-cfad6cdbb4a3 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.164073 Aug 23 22:31:58.027976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 85/155] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:57 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:58.063370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.071124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-868c904a-1dc0-4a7a-bd59-d2a51be195db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.155214 Aug 23 22:31:58.071696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 71/156] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:57 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:58.267482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:58.268087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:58.274964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.275610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.276141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.277166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.277715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.278135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.413473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.421904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e8cf53cf-90b1-4c8f-b6be-cb179c5e7e12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.158168 Aug 23 22:31:58.422512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 86/157] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:58 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:59.047105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:59.047710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:59.054347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.054838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.055274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.055960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.056418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.056841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.091849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:59.092686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:59.099012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.099501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.099939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.100636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.101436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.101861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.193733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.201587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e46d931-6d67-43c0-a137-da10d31de408 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.158365 Aug 23 22:31:59.202163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 72/158] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:59 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:59.242243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.250468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-525ff590-3df5-497b-a5ae-de5910807dd3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.162498 Aug 23 22:31:59.250987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 87/159] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:59 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:59.442989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:59.443591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:59.449469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.449948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.450378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.451164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.451611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.452032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.583592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.592871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85a281ab-44b2-4004-a0e3-6e58b773556c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.153578 Aug 23 22:31:59.593745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 73/160] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:59 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:00.223241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:00.223918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:00.230236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.230716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.231145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.231831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.232357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.233073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.272806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:00.274092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:00.288570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.296166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.296166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.296166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.296166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.296576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.445464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:00.447811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f93286bc-1536-4a0c-b980-a6c5f8001603 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.228918 Aug 23 22:32:00.448947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 88/161] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:00 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:00.469429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:00.481673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-61f20f42-3ebe-4fa6-befd-3f409669c003 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.211219 Aug 23 22:32:00.481673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 74/162] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:00 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:00.614817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:00.615651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:00.621581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.622070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.622503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.623199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:00.623647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:00.624071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:00.767276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:00.775614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7b8edbfc-271e-45a9-b8e9-79ffb4bbb4e0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.164969 Aug 23 22:32:00.776183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 89/163] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:00 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:01.202439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba92e33-0332-41e6-8ae0-edb3db94d4e6", "name": "network-vif-plugged", "status": "completed", "tag": "b80c9e2b-7745-482f-981d-a9d71d3f76ad"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:01.215935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.216858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.217703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.234782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] Creating event network-vif-plugged:b80c9e2b-7745-482f-981d-a9d71d3f76ad for instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 on hv-cinder-84254 Aug 23 22:32:01.240634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-1c0d1309-eee1-4aa6-9fb9-92a956794360 req-f5dba3e0-ff4b-48a2-8c49-2b0a4e98b450 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042709 Aug 23 22:32:01.241292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 75/164] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:01.470465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:01.471134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:01.479366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.479918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.480305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.481004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.481562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.482009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.501244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:01.505138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:01.512996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.514937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.518876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.519823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.520320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.520751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.525667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:01.657748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.666430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a25bb2c5-132e-4e42-b9b7-4279ed211bae tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.200447 Aug 23 22:32:01.667013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 90/165] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:01 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:01.681756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.693225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-228ff6b9-78a9-4c4b-9163-7c8e0b572e3d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.196277 Aug 23 22:32:01.693818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 76/166] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:01 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:01.795948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:01.796578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:01.802776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.803272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.803725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.804904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.805457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.805887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.975298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.984240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7d3b5984-75f6-47ef-b2f1-088514bc1639 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.192109 Aug 23 22:32:01.984819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 91/167] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:01 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:02.688178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:02.688825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:02.695441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.695956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.696395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.697133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.697587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.698039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.715720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:02.730014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:02.735396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.736235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.736962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.738239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.739020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.739745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.866830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:02.867420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-60e0935e-1789-47f8-84a2-15402284fb02 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.183389 Aug 23 22:32:02.867991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 77/168] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:02 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:02.900002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:02.907917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-333165c0-dd7f-4f85-8fd2-c322dc81721c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.197719 Aug 23 22:32:02.908478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 92/169] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:02 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:03.009576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:03.009576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:03.015881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.015881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.016293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.016881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.017354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.017818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.158459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:03.166925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ecfb876e-5d2d-42c2-80f5-587afb4271e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.162757 Aug 23 22:32:03.167496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 78/170] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:03 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:03.890205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:03.890805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:03.897957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.898432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.898856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.899529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.899973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.900389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.904499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:03.928621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:03.929626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:03.935826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.936306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.936739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.937458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.937910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.938326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:04.036403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.044236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-617073d1-002a-4996-8851-75a295e50175 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.157697 Aug 23 22:32:04.044764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 93/171] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:03 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:04.078992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.087194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4781471-4a45-48a1-956b-dbbb0630f0e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.162514 Aug 23 22:32:04.087765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 79/172] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:03 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:04.187629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:04.188239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:04.194918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:04.195400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:04.195834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:04.196529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:04.196980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:04.197433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:04.335702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.343289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e33f13d1-67f7-46df-bacb-1590c1985d41 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.159523 Aug 23 22:32:04.343980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 94/173] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:04 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:05.065038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:05.065682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:05.067623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:05.072619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.072967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.073433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.074124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.074614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.075040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.108779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:05.109536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:05.116276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.116761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.117221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.117916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.118472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.119075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.227065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.244745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02800464-e5f1-47d6-8b7a-2c762a2d2156 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.174901 Aug 23 22:32:05.244745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 80/174] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:05 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:05.267134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.276024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b945fdb2-74a2-438d-b8ed-0bcb58d7e37d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.171442 Aug 23 22:32:05.276686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 95/175] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:05 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:05.364670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:05.365336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:05.371199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.371683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.372122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.372802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.373278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.373696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.507107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.515165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b77b935b-c86c-4d88-9e29-3efec610f682 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.154270 Aug 23 22:32:05.515755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 81/176] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:05 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:06.264875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:06.265601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:06.273844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.274367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.274925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.275538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.275992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.276547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.303525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:06.304137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:06.310589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.311085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.316715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.316715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.316715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.316715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.424987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:06.433909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6baee66d-7eee-4f12-9824-ddb8a49b7b2d tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.173555 Aug 23 22:32:06.434687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 96/177] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:06 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:06.457432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:06.467648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eb9678f3-9c95-491d-99c7-0657a5b15a97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.167981 Aug 23 22:32:06.468375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 82/178] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:06 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:06.537450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:06.537998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:06.544112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.544606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.545121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.545768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.546225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.546794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.699499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:06.710951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9008b7a0-003f-42bc-87a0-c66c4dd23a84 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.178756 Aug 23 22:32:06.711541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 97/179] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:06 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:07.455467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:07.456093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:07.462227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.464072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.464454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.465740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.466195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.466608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.501211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:07.502011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:07.508455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.508976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.509438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.510214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.510670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.511117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.617321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.631900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8ca131c7-3946-4e85-a8db-375bb91cd464 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.179836 Aug 23 22:32:07.633105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 83/180] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:07 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:07.661910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.670535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-215c32da-50a9-4b60-ba7b-40594d2c694b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.173013 Aug 23 22:32:07.671251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 98/181] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:07 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:07.735577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:07.736360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:07.746131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.746681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.747126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.747843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:07.748335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:07.748817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.889948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.898815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-87b8eb2a-0264-474d-9a33-ef65787faa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.170118 Aug 23 22:32:07.899405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 84/182] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:07 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:08.653206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.653847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.660671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.661220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.661533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.662227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.662746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.663279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.695006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.695697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.702037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.702955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.703549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.704271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.704734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.705194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.831716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:08.840582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e38f0b01-40d3-4e7f-ba8e-921db5389800 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.191201 Aug 23 22:32:08.841186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 99/183] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:08 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:08.855381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:08.864146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b51ae059-deeb-42a2-a11b-ae8072193741 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.172761 Aug 23 22:32:08.864415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 85/184] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:08 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:08.919695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.920341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.926558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.927060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.927497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.928191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.928641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.929092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.102955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:09.110819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-75df7351-6b41-4379-ad22-94ed2946a72e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.194896 Aug 23 22:32:09.111397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 100/185] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:08 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:09.863965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:09.864546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:09.870406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.870886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.871308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.871977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.872470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.872826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.883835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:09.884440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:09.890602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.891085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.891525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.892212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.892655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.893109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:10.038512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:10.049026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2f2051db-8801-4526-bd97-38e7684f0d51 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.189458 Aug 23 22:32:10.049996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 86/186] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:09 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:10.060712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:10.070193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9086e5b-c5cc-478c-8997-ed7039917826 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.190048 Aug 23 22:32:10.070777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 101/187] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:09 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:10.133551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.134148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:10.140085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:10.140564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:10.141000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:10.141707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:10.142155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:10.142580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:10.283117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:10.291941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-60d1cc59-5115-4b69-a575-5ed076dbc3fe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.162330 Aug 23 22:32:10.304892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 87/188] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:11.070574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.071395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:11.076962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.081411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.081411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.081411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.081411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.082222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.093613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.095777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:11.104492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.104987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.105453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.106482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.107099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.107742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.251660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.259734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4e192e94-f368-47cd-a6d5-ccb1d7f4f318 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.192956 Aug 23 22:32:11.265818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 102/189] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:11.267353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.275267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0338177c-15b3-4336-b416-3d4150b7aa12 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.187209 Aug 23 22:32:11.275833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 88/190] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:11.312349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.312961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:11.319743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.320224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.320709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.321369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:11.321821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:11.322240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.468336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.476854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8a4a6ee-c302-44a0-a6da-f22e8dda7934 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.168309 Aug 23 22:32:11.477499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 103/191] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:12.279900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:12.280870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:12.282832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=88 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:12.289986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.289986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.289986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.290266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.291311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.291977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.297338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:12.298003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:12.304681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.305183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.305640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.306319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.307103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.307679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.436082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.444613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a7c46a6-3435-4a70-9f89-a55e9ced2ae5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1313 microversion: 2.1 time: 0.168530 Aug 23 22:32:12.445215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 89/192] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:12 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:12.449973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8f6ad2-07f8-4f77-81d2-70e697b1e275", "name": "network-vif-plugged", "status": "completed", "tag": "56d68285-5ed7-44d0-af14-bbfdf7877de6"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:12.460697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.461207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.461634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.473983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] Creating event network-vif-plugged:56d68285-5ed7-44d0-af14-bbfdf7877de6 for instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 on hv-cinder-84254 Aug 23 22:32:12.475842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.479871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-a811966e-ee6f-4f2a-8f09-1bb2707b9246 req-85a33872-3b67-4ddf-a5d7-b9e847b0e23f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Aug 23 22:32:12.480544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 90/193] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:12.485701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3c55f98a-74bd-4cf2-ab21-91c247c5be2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1322 microversion: 2.1 time: 0.192950 Aug 23 22:32:12.493243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 104/194] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:12 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:12.510385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:12.511109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:12.517550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.518897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.519722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.520643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.521385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.521992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.666395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.678475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c5678192-0911-472f-b32f-993f605fd0db tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.172161 Aug 23 22:32:12.679111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 91/195] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:12 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:13.467839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:13.468451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:13.470856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=90 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:13.476636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.483660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.483660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.483660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.483660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.484033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.516065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:13.517133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:13.526703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.528024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.528732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.530044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.530790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.531322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.632860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.640747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c906aa01-938f-41bb-bc5f-49d5977e4144 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1500 microversion: 2.1 time: 0.177090 Aug 23 22:32:13.641960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 105/196] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:13 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1500 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:13.703039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:13.704110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:13.710642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.711219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.711658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.712400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.712854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.714496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.731875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.742252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3b866e44-5981-4276-a0cd-bfa64b5d1c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1516 microversion: 2.1 time: 0.233327 Aug 23 22:32:13.742957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 92/197] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:13 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:13.771402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:13.775785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:13.785066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.786850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.787845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.790563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.791732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.792570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.861217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:13.866460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'flavor' on Instance uuid be5efd28-1582-46ac-b8b3-5a2c48232b38 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:32:13.900963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.910287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b59ab79d-3bc3-4aae-b970-88056eee4345 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.212941 Aug 23 22:32:13.910868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 106/198] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:13 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:14.480238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6fda6d0e-e9a8-4418-bfa8-a1ee8fd0b3d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38/action" status: 200 len: 32 microversion: 2.1 time: 0.716953 Aug 23 22:32:14.481726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 93/199] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:32:13 2022] POST /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38/action => generated 32 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 22:32:14.506503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:14.506503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:14.516287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.524628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.524628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:14.524628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.524628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.526005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:14.707482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:14.728587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f77593aa-f1cc-4cba-8138-a8a1b2e924db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.224079 Aug 23 22:32:14.728587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 107/200] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:14 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:14.932037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:14.932725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:14.939439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.939903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.941153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:14.941871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.942318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.942782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:15.111255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:15.129455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7054a6ac-ba0f-4d47-bd02-6d02c62d978e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.201153 Aug 23 22:32:15.141381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 94/201] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:14 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:15.738313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:15.738926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:15.745167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:15.745664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:15.746105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:15.746988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:15.747447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:15.747871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:15.903220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:15.911683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cd89ec07-0797-4310-b65c-4704a004dce2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.178185 Aug 23 22:32:15.912477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 108/202] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:15 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:16.157746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:16.158590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:16.169857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.170369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.170804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.171531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.171978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.172394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.490014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:16.505571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ee4266d-127d-4b88-adce-de0ae3f6d570 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.353283 Aug 23 22:32:16.507250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 95/203] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:16 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:16.596392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab3761bb-ce83-4312-8be7-628a8afcfd95"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:16.599176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:16.609426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.609915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.610345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.611044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.611493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.611941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.757945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:16.933822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:16.934428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:16.940848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.941194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.941782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.942469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:16.942911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:16.943327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:17.078065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:17.086218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9513d22e-2fb5-4235-91c0-23432a3c62c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.156170 Aug 23 22:32:17.086786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 96/204] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:16 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:17.529916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:17.530675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:17.537806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:17.538295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:17.538729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:17.539423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:17.539872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:17.540463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:17.759663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:17.779918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5fad005b-31f9-41af-ab76-4c783f1552a6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.255721 Aug 23 22:32:17.780659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 97/205] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:17 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:18.109948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:18.110768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:18.118057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.118735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.119187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.120126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.120895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.121505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.276430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:18.285865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31cccf70-c60a-4dac-bbb2-770f121fab9b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.181462 Aug 23 22:32:18.286655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 98/206] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:18 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:18.802001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:18.802687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:18.809114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.809605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.810084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.810784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.811237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.811656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.957995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:18.966119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e769d13b-657f-4132-a3cd-4d292c7324ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.168153 Aug 23 22:32:18.966696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 99/207] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:18 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:19.309807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:19.310413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:19.322057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.322602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.323012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:19.323703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.324202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.324546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:19.464574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:19.472756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d72ab6dd-f14c-4e5c-bcd4-e0c06c43142b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.169323 Aug 23 22:32:19.473470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 100/208] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:19 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:19.989663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:19.990263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:19.996293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.996780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.997429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:19.998228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.998550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.998967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:20.159743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:20.168048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3a7cea4-eb39-4191-94cb-5811584c7d7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.183846 Aug 23 22:32:20.169056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 101/209] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:19 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:20.495113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:20.495716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:20.501875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:20.502416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:20.503159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:20.503939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:20.504573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:20.505049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:20.652229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:20.661941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb639afa-94ab-43f2-8060-0eb716200ea6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.170372 Aug 23 22:32:20.662942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 102/210] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:20 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:21.190192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:21.190870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:21.196980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.197528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.197964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.198657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.199141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.199565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.335807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:21.343586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-32468eac-1d12-4f89-ad64-f5569d1c885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.157770 Aug 23 22:32:21.344162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 103/211] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:21 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:21.692047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:21.692669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:21.698626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.699111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.699554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.700243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.700690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.701142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.845166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:21.847942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6087a0ce-4313-434e-be25-b97db8550fd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.160395 Aug 23 22:32:21.848859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 104/212] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:21 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:22.373421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:22.374044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:22.380782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.381294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.381729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.382426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.382904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.383427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.514729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:22.522650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-96a59728-9eb8-42b4-b05a-80dbac229746 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1362 microversion: 2.1 time: 0.153029 Aug 23 22:32:22.523249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 105/213] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:22 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:22.869237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:22.869839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:22.875639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.876114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.876540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.877351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.877760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.878370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.025716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:23.034345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4069cfee-105f-46b4-aa5a-6b0492b6804e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.168127 Aug 23 22:32:23.035114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 106/214] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:22 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:23.544857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:23.545541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:23.556161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.556161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.556161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.556674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.557061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.557760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.748106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:23.756162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c9a0b9f-bd45-4618-9891-9b7f257dfcc2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1547 microversion: 2.1 time: 0.215726 Aug 23 22:32:23.756884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 107/215] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:23 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1547 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:23.779856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:23.780483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:23.787176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.787652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.788081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.788756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.789228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.789638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.793529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:23.875697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ab63656d-21bf-47f5-8a49-78d4740c0774 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100141 Aug 23 22:32:23.876410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 108/216] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 22:32:23 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:24.072354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:24.072980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:24.086321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:24.087162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:24.087608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:24.088363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:24.088845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:24.089523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:24.259218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:24.275288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c6478524-eea1-4b96-9d36-dafd4137e560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.206610 Aug 23 22:32:24.275538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d000d993-6dfe-451f-9443-673caedb0490 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "POST /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.681279 Aug 23 22:32:24.275538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 109/217] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:32:16 2022] POST /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1/os-volume_attachments => generated 194 bytes in 7684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:24.289543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 109/218] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:24 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:25.306290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:25.307314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:25.313991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:25.314543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:25.314987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:25.316051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:25.316516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:25.316942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:25.564149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:25.574621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f53fa74b-e7ef-43f9-a241-163475878b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.277313 Aug 23 22:32:25.575206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 110/219] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:25 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:25.618087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8f6ad2-07f8-4f77-81d2-70e697b1e275", "tag": "56d68285-5ed7-44d0-af14-bbfdf7877de6"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:25.629155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:25.629431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:25.629689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:25.642428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] Creating event network-changed:56d68285-5ed7-44d0-af14-bbfdf7877de6 for instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 on hv-cinder-84254 Aug 23 22:32:25.647610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-a9bdc019-94b3-421a-8322-e1a066d11d61 req-695b02b2-306b-4cb5-a01c-8af17342977b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Aug 23 22:32:25.648380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 110/220] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:26.596134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:26.603991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:26.603991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:26.604365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:26.604733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:26.605454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:26.605903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:26.606324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:26.750954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:26.759261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1e9c0a0d-c156-47b0-8c55-8704737b3a7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.167117 Aug 23 22:32:26.759830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 111/221] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:26 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:27.780990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:27.781723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:27.788943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:27.789446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:27.789875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:27.790582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:27.791031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:27.791438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:27.924305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:27.932055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d960ce83-d1ea-4791-9ac6-d271043cd56e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.155699 Aug 23 22:32:27.932844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 111/222] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:27 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:28.954736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:28.955495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:28.962525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:28.963080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:28.963601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:28.964401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:28.964924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:28.965466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:29.101433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:29.109156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-81040a18-9e9f-4219-9c4d-8718dabad42b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.159139 Aug 23 22:32:29.109706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 112/223] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:28 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:30.132977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:30.133616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:30.139975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:30.140455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:30.140887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:30.141614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:30.142066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:30.142484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:30.281383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:30.290194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-66a846eb-eefd-40bc-baa0-7fb37bd353ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.162280 Aug 23 22:32:30.290800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 112/224] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:30 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:31.311641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:31.312354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:31.318857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.319255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.319700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.320566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.320868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.321436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.466810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:31.475738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b55acdc0-e7c1-4f26-9b77-f2b7b848d8e4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.168031 Aug 23 22:32:31.476331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 113/225] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:31 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:32.496816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:32.497439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:32.504044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.504683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.505161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.505947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.507334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.507757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.648305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:32.656296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-77b51e05-aea6-4fab-95e7-15405f734a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.163261 Aug 23 22:32:32.657108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 113/226] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:32 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:33.678664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:33.679287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:33.686299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:33.686828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:33.687365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:33.688186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:33.688695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:33.689210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:33.836282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:33.844335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b397035d-0a2a-4bee-a294-31dd5890e29c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.169957 Aug 23 22:32:33.844914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 114/227] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:33 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:34.867378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:34.868202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:34.877611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:34.877611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:34.877611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:34.877611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:34.877988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:34.877988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:35.028483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:35.037509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-de7ef916-973d-4b13-9e6d-4309a1a5e16a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.173664 Aug 23 22:32:35.038097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 114/228] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:34 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:36.060157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:36.067961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:36.079718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:36.080271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:36.080751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.082113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:36.083286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:36.083286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.228663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:36.236919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cbe2f4c8-bddd-42e1-8c47-c251fcabad6f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.181375 Aug 23 22:32:36.238039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 115/229] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:36 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:37.260570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:37.261228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:37.267375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:37.267857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:37.268291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:37.269676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:37.270128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:37.270578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:37.407142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:37.415226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bbd352b6-d904-480b-a55a-c2c845b3e49e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.158643 Aug 23 22:32:37.415792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 115/230] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:37 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:38.435800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:38.436445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:38.443474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:38.443969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:38.444410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:38.445142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:38.445601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:38.446028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:38.578836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:38.586882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5f19ff03-a126-4c1b-a71a-c177c93fbe16 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.154905 Aug 23 22:32:38.587455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 116/231] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:38 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:39.608169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:39.608777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:39.614982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:39.615466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:39.615909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:39.616602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:39.617072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:39.617502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:39.757728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:39.763844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d8a9236-8977-47e0-97e3-7cf1cfe38266 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.159515 Aug 23 22:32:39.764400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 116/232] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:39 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:40.786392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:40.787018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:40.793509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.793993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.794425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.795114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.795564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.795983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.931425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:40.939645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c15abc40-5b3a-4728-8230-d8a4eedb1380 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.158159 Aug 23 22:32:40.940221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 117/233] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:40 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:41.960302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:41.960921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:41.967126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.967617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.968067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.968775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.969261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.969714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:42.106097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:42.115461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a84ab69-2e4d-42db-9c5a-de8daa35982f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.158978 Aug 23 22:32:42.116115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 117/234] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:41 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:43.136668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:43.137220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:43.143755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:43.144397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:43.145135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:43.145841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:43.146294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:43.146717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:43.284260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:43.291801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7509b0b7-162b-4cfd-9d49-e50ffd610145 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.159063 Aug 23 22:32:43.292360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 118/235] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:43 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:44.312684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:44.313233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:44.315203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=58 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:44.320188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:44.320673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:44.321153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:44.321881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:44.322336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:44.325128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:44.452819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:44.460994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0ec442e5-efcb-4647-8edc-250a4aecb8c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.152280 Aug 23 22:32:44.461584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 118/236] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:44 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:45.482163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:45.482687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:45.485178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=28 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:45.491183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:45.491673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:45.492107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:45.492844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:45.493300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:45.493727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:45.627531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:45.635864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9430d893-be8f-4aad-a398-b2c66b5b10b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.157645 Aug 23 22:32:45.636530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 119/237] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:45 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:46.657703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:46.658332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:46.665536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:46.666140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:46.666685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:46.667695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:46.668291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:46.668712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:46.811906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:46.820969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-095b702b-b8ac-4be7-8579-4c1f43080b39 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.167052 Aug 23 22:32:46.821592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 119/238] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:46 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:47.843436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:47.843436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:47.848284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:47.849275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:47.849723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:47.850532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:47.850959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:47.851375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:47.855405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:48.003053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:48.015880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ae3a4755-1415-4235-a84d-d455f69c44b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.174182 Aug 23 22:32:48.027119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 120/239] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:47 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:49.034353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:49.037603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:49.043581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:49.043725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:49.044195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:49.044977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:49.045453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:49.045863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:49.188003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:49.199196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4440627d-1a96-4fbd-9a1f-aeefe0e27966 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.168463 Aug 23 22:32:49.199695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 120/240] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:49 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:50.219981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:50.220589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:50.228928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:50.229446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:50.229873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:50.230639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:50.231085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:50.231502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:50.370030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:50.377653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-767a1f5d-3a17-4e88-bf40-9a459b8929b0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.161670 Aug 23 22:32:50.378208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 121/241] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:50 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:51.398482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:51.399100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:51.405304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:51.405795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:51.406228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:51.406961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:51.407439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:51.407865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:51.546609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:51.563660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dea374e1-0555-4124-8c31-e7dd1eba1430 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.169137 Aug 23 22:32:51.576939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 121/242] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:51 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:52.590308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:52.590921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:52.597002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:52.597582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:52.598010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:52.598954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:52.599398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:52.599813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:52.751497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:52.760814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45d5070b-3734-4bd1-8a74-5737fa4383dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.180610 Aug 23 22:32:52.761449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 122/243] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:52 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:53.783210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:53.783832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:53.789885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:53.790579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:53.791025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:53.791718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:53.792171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:53.792596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:53.947552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:53.955239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f103d036-527f-4e6b-b88b-be11aaaf38b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.176492 Aug 23 22:32:53.956137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 122/244] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:53 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:54.982528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:54.983152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:54.992417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:54.995154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:54.998815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:55.000122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:55.002052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:55.002551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:55.157132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:55.166025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fd598b2c-d0b2-4c6e-81dd-f01563dbcf84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.190519 Aug 23 22:32:55.166620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 123/245] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:54 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:56.188403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:56.189506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:56.195725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:56.196442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:56.197114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:56.197993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:56.198686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:56.199309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:56.399192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:56.407145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a584eed-ce2d-4a93-bda1-23d4070f1f78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.222803 Aug 23 22:32:56.419177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 123/246] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:56 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:57.433620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:57.434218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:57.440684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:57.441350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:57.441909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:57.442743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:57.443274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:57.444364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:57.632687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:57.651765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-277194e3-4880-4ddf-b2e0-7b56df84b573 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.222591 Aug 23 22:32:57.665177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 124/247] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:57 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:58.674419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:58.675040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:58.682405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:58.683109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:58.683360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:58.684060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:58.684510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:58.685283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:58.826699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:58.835476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-44194bf7-ed91-4d29-ab12-8d00168ce433 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.164319 Aug 23 22:32:58.836270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 124/248] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:58 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:59.856734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:59.857496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:59.864373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:59.864901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:59.866125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:59.868369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:59.869029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:59.869528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:00.008861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:00.016319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-04f93b44-18e5-40c6-ae27-b8b3185850af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.163864 Aug 23 22:33:00.016869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 125/249] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:59 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:01.037364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:01.038124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:01.044142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:01.044615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:01.045062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:01.045740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:01.046185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:01.046599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:01.049132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=95 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:01.184026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:01.192206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6852672d-7bc6-438d-95a0-0359d77faade tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.158610 Aug 23 22:33:01.192721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 125/250] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:01 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:02.216387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:02.217197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:02.226032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:02.226814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:02.227310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:02.228187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:02.228652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:02.229129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:02.378042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:02.390008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f45ebcdb-7a23-4f81-97b1-cfbe6e12f071 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.179584 Aug 23 22:33:02.390589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 126/251] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:02 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:03.412007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:03.412579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:03.418769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:03.419232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:03.419661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:03.420334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:03.420781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:03.421221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:03.561349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:03.568918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5cda1d7-e5b0-423f-81f6-8573696a91cd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.161114 Aug 23 22:33:03.569529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 126/252] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:03 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:04.464806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:04.465341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:04.471658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.473401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.473401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.473600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.473926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.474343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.502387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:33:04.590190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:04.590889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:04.597152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.597651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.598409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.599078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.599535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.599994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.735766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:04.744087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ef3c412c-25b9-4ea2-9b4e-8e63028f63b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.158484 Aug 23 22:33:04.744646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 127/253] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:04 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:05.015580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d2f144db-3398-4423-a6c7-dc3234b0d335 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 204 len: 0 microversion: 2.1 time: 0.553920 Aug 23 22:33:05.016229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 127/254] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:33:04 2022] DELETE /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:33:05.035199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:05.043637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:05.050806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.051371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.052027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.053136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.053756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.055001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.215824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:05.224910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0116dd1d-7e9f-47a7-9e36-effcc248c94b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.194128 Aug 23 22:33:05.225522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 128/255] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:05 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:05.765079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:05.765768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:05.772079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.772552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.780256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.780256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.780256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.780256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.912265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:05.920311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e97db8ef-6f7f-4b75-99b3-bfc96ca47e0b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.159283 Aug 23 22:33:05.920886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 128/256] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:05 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:06.247551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:06.248101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:06.255704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.256201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.256636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:06.257691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.258178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.258609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:06.396311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:06.405882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9c3491a1-0af4-4420-be5b-463b74314a65 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.162317 Aug 23 22:33:06.406931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 129/257] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:06 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:06.941598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:06.942307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:06.950080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.950667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.951104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:06.951806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.952257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.952682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:07.099343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:07.107525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9602e921-9f9e-4535-ada5-03e39fcb62c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.170265 Aug 23 22:33:07.108107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 129/258] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:06 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:07.432996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:07.434412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:07.440919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:07.441628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:07.442267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:07.442986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:07.444182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:07.445416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:07.681092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:07.697727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-163b59b2-fb26-45f6-851e-2258604cfd05 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.266745 Aug 23 22:33:07.699249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 130/259] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:07 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:08.128047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:08.128664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:08.136307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.136869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.137398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.138088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.138623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.138967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.286239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:08.302846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-051b9392-cf74-4997-af8b-99c9e6237a67 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.178844 Aug 23 22:33:08.303737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 130/260] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:08 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:08.719412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:08.720024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:08.726455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.727057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.727498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.728192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.728642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.729092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.862361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:08.871022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-869d2a80-bf31-4bc3-8788-1259b95315e0 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.155367 Aug 23 22:33:08.871618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 131/261] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:08 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:09.323960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:09.324786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:09.331996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:09.332488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:09.332973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:09.333683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:09.334140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:09.334564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:09.467417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:09.476460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8a5727dd-47eb-4768-8c1b-b7d6f19c000d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.155802 Aug 23 22:33:09.477561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 131/262] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:09 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:09.892262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:09.892826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:09.899515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:09.899998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:09.900436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:09.901148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:09.901598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:09.902013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.037772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:10.046418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-baabd483-8098-4e9f-812e-24c0d9ca1072 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.158058 Aug 23 22:33:10.046989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 132/263] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:09 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:10.498907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:10.499716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:10.506433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.507625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.508274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.509056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.509614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.510044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.645985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:10.655239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c27dbe42-d958-42f2-bffa-8313bfc72405 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.160162 Aug 23 22:33:10.655818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 132/264] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:10 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:11.071573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:11.072178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:11.080598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:11.080598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:11.080598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:11.080598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:11.080929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:11.080929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:11.216720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:11.225456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f8111f53-03c4-4a0e-8c7c-986654120616 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.157697 Aug 23 22:33:11.226853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 133/265] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:11 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:11.676616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:11.677171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:11.684281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:11.684753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:11.685518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:11.686204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:11.686647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:11.687154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:11.849719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:11.858697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2c9d16f7-aade-44fc-ab75-1045c774862e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.185910 Aug 23 22:33:11.859355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 133/266] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:11 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:12.248360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:12.248963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:12.254956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.255441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.255874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.256555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.257098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.257615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.396045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:12.405659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a187ac6-5f7c-4d99-b7ad-209adbd9e247 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.161056 Aug 23 22:33:12.406244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 134/267] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:12 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:12.879909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:12.880445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:12.887728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.888214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.888656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.889381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.889835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.890257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:13.025455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:13.036301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-16335a5f-2229-4abf-b8dc-e021dfab6930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.160125 Aug 23 22:33:13.036875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 134/268] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:12 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:13.427652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:13.428451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:13.435964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:13.436443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:13.436872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:13.437979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:13.438459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:13.438870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:13.624675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:13.636813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dff2c169-4e49-4f00-b395-d14dbdd67dea tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.213086 Aug 23 22:33:13.646409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 135/269] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:13 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:14.058231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:14.058941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:14.065586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:14.066057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:14.066514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:14.067270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:14.067752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:14.068175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:14.071310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:14.208840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:14.218104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-117a2aea-af18-4130-9c42-6ab97dcd02e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.164709 Aug 23 22:33:14.218840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 135/270] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:14 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:14.659439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:14.660072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:14.662191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=36 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:14.667407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:14.667961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:14.668544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:14.669278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:14.669740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:14.670234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:14.816712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:14.829268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3086ed5b-634b-4b2b-bd5f-cd0ea3de8fe5 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.172592 Aug 23 22:33:14.829268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 136/271] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:14 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:15.240424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:15.241203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:15.249490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:15.249978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:15.250412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:15.251102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:15.251548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:15.251960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:15.436665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:15.445028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-caea22f6-1a29-43fa-b79f-2ca52c2061bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1522 microversion: 2.1 time: 0.208189 Aug 23 22:33:15.445725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 136/272] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:15 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:15.859393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:15.859393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:15.860405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:15.860826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:15.861470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:15.862451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:15.863082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:15.863924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.077520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:16.091054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-40b35d30-2075-4b2e-b4fb-2257cb4bbcce tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1552 microversion: 2.1 time: 0.243313 Aug 23 22:33:16.094732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 137/273] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:15 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:16.469276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:16.470030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:16.474535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:16.496957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:16.497757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:16.500395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.501659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:16.502389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:16.504097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.646685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1", "name": "network-vif-deleted", "tag": "60eabd9e-c078-4535-8434-ce6f397ae447"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:16.659739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:16.660296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:16.660718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.676981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] Creating event network-vif-deleted:60eabd9e-c078-4535-8434-ce6f397ae447 for instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 on hv-cinder-84254 Aug 23 22:33:16.691922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-4eead3e0-1de1-40e4-8921-833b76bf3679 req-d2e151fb-b82c-467d-839d-43a1738febfa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049399 Aug 23 22:33:16.693083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 138/274] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:16.728727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:16.743299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a2936f39-ddf7-483e-9e91-69b252b904e1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1502 microversion: 2.1 time: 0.280133 Aug 23 22:33:16.745339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 137/275] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:16 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:16.768319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:16.769143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:16.777097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:16.777637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:16.778072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.779025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:16.779639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:16.780414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:16.960635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:16.974415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-687af119-c97a-4109-8c81-1ca83d4aa84f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1517 microversion: 2.1 time: 0.207741 Aug 23 22:33:16.974415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 139/276] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:16 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1517 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:17.116068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:17.117240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:17.124488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:17.125281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:17.125933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:17.126979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:17.127604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:17.128182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:17.200058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:17.209260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8b271e1-6793-43ff-9936-5f1f8de3aa9b tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1344 microversion: 2.1 time: 0.098312 Aug 23 22:33:17.210331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 138/277] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:17 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:18.232372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:18.233135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:18.239433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:18.239924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:18.240356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:18.241294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:18.241897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:18.242478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:18.311918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:18.321373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a85d73c5-e031-49ad-9bdd-7294032d9087 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1344 microversion: 2.1 time: 0.092928 Aug 23 22:33:18.321998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 140/278] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:18 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:19.342135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:19.343437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:19.351295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:19.351822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:19.352261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:19.352972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:19.353689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:19.354109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:19.403079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:19.403578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:19.404014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:19.404570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lazy-loading 'fault' on Instance uuid 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:33:19.452956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7b02646d0d499b8928aed95f10e9ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5882c9c6cf794b3ab17230304c169f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:19.461456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ef3b77a4-70df-4e45-be04-ab8c0c22882f tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 200 len: 1303 microversion: 2.1 time: 0.122914 Aug 23 22:33:19.465987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 139/279] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:19 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:20.008219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:20.010430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:20.016446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.016920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.017389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.018081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.018524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.018942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.044333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'flavor' on Instance uuid 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:33:20.072391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:20.483444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:20.484114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:20.491439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.491934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.492415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.493158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.493614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.494036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.509084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] HTTP exception thrown: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Request method failure captured: Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 HTTP/1.1 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUvIg5qjVwsJhv5XTI4Vnq9hLbpzTMCi8Kqh5QEkdrz73WmGRKDJmfNA0iTMC8gSQb5W3rxu0OI4-8M2kwKrMOvdJm3C9TxKlZWX-lcYp45x6dQGPQJScD0Y2upKS-C31WAvfywbaskfETaM4I6Xyr8UZpLBAp7aOC79NP52BZe8gA Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:33:20.513895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5882c9c6cf794b3ab17230304c169f07", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 1c7b02646d0d499b8928aed95f10e9ac Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.515510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1'} Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:20.516331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.518883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Returning 404 to user: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:20.518883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4975c13-2ae5-42ed-a2f9-3a52b003c55e tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 404 len: 111 microversion: 2.1 time: 0.035936 Aug 23 22:33:20.519405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 140/280] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:20 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:33:20.553048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c0ad100f-0db1-4694-9575-f8924046ccbd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/action" status: 200 len: 32 microversion: 2.1 time: 0.547423 Aug 23 22:33:20.569942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 141/281] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:33:20 2022] POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/action => generated 32 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:33:20.578999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:20.579530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:20.591239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.592782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.593923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.595349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.596504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.598866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.793050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:20.796717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:20.803524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.804256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.808324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.809282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:20.809916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:20.810342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:20.825461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] HTTP exception thrown: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Request method failure captured: Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1/os-volume_attachments HTTP/1.1 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUvIg5qjVwsJhv5XTI4Vnq9hLbpzTMCi8Kqh5QEkdrz73WmGRKDJmfNA0iTMC8gSQb5W3rxu0OI4-8M2kwKrMOvdJm3C9TxKlZWX-lcYp45x6dQGPQJScD0Y2upKS-C31WAvfywbaskfETaM4I6Xyr8UZpLBAp7aOC79NP52BZe8gA Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:33:20.830352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5882c9c6cf794b3ab17230304c169f07", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 1c7b02646d0d499b8928aed95f10e9ac Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.831568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'server_id': '2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1'} Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:20.832312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:20.833481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:20.836778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Returning 404 to user: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:20.837941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-65a3de6a-b71b-41a2-9cc5-c6384f6e1842 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050730 Aug 23 22:33:20.839055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 142/282] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:33:20 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:21.178215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:21.186651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5943fefe-2fdd-4eb2-814e-31d979cee3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.611621 Aug 23 22:33:21.189508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 141/283] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:20 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:22.208099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:22.208704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:22.216090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.216583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.217029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.217735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.218379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.218964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.363102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:22.372645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f31a6468-ce58-4c81-bf4b-bfa091fee9c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.168190 Aug 23 22:33:22.385478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 143/284] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:22 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:22.393170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:22.393871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:22.415429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.415978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.416586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.421340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.423696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.424540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.447568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] HTTP exception thrown: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Request method failure captured: Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 HTTP/1.1 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUvIg5qjVwsJhv5XTI4Vnq9hLbpzTMCi8Kqh5QEkdrz73WmGRKDJmfNA0iTMC8gSQb5W3rxu0OI4-8M2kwKrMOvdJm3C9TxKlZWX-lcYp45x6dQGPQJScD0Y2upKS-C31WAvfywbaskfETaM4I6Xyr8UZpLBAp7aOC79NP52BZe8gA Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:33:22.449140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5882c9c6cf794b3ab17230304c169f07", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 1c7b02646d0d499b8928aed95f10e9ac Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.450439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1'} Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:22.451159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.452214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.461509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Returning 404 to user: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:22.461509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dbf90cd9-0e44-4358-9847-19f5279c8380 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 404 len: 111 microversion: 2.1 time: 0.064137 Aug 23 22:33:22.461509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 142/285] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:33:22 2022] DELETE /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:22.465614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:22.466082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] [instance: 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:22.472108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.472856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.473314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.474023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:22.474470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:22.475762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:22.502376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] HTTP exception thrown: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Request method failure captured: Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 HTTP/1.1 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUvIg5qjVwsJhv5XTI4Vnq9hLbpzTMCi8Kqh5QEkdrz73WmGRKDJmfNA0iTMC8gSQb5W3rxu0OI4-8M2kwKrMOvdJm3C9TxKlZWX-lcYp45x6dQGPQJScD0Y2upKS-C31WAvfywbaskfETaM4I6Xyr8UZpLBAp7aOC79NP52BZe8gA Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:33:22.504745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5882c9c6cf794b3ab17230304c169f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5882c9c6cf794b3ab17230304c169f07", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 5882c9c6cf794b3ab17230304c169f07 Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-DeleteServersTestJSON-744258056 Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 1c7b02646d0d499b8928aed95f10e9ac Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-DeleteServersTestJSON-744258056-project Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.505975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1'} Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:22.507338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. Aug 23 22:33:22.508413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:33:22.509989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] Returning 404 to user: Instance 2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:22.509989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97ebbe03-2e94-417c-9ccf-d109fc105f58 tempest-DeleteServersTestJSON-744258056 tempest-DeleteServersTestJSON-744258056-project] 10.222.0.73 "GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1" status: 404 len: 111 microversion: 2.1 time: 0.044421 Aug 23 22:33:22.509989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 144/286] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:22 2022] GET /compute/v2.1/servers/2dd72865-0ffb-4e8a-bdfa-d3eaa9f432b1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:23.404901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:23.408770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:23.426304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:23.427122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:23.427835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:23.431097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:23.431636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:23.432343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:23.713445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:23.719974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1d9588ef-66ec-451f-a14c-4f1aebe37158 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.323576 Aug 23 22:33:23.726256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 143/287] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:23 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:24.746607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:24.747212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:24.753597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:24.754082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:24.754516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:24.755504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:24.757431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:24.758058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:25.110868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:25.119124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b99b88f6-d533-4f91-b266-a8147b1925bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.376491 Aug 23 22:33:25.119917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 145/288] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:24 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:26.158710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:26.159337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:26.173585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:26.173585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:26.173585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:26.173585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:26.173884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:26.173884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:26.373131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:26.382389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aae0b6e5-243f-4b15-b2b6-eb3ff70fad5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.244428 Aug 23 22:33:26.383107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 144/289] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:26 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:27.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:27.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:27.424123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:27.425916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:27.427219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:27.429044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:27.433054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:27.433782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:27.870161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:27.888317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e9748dc5-4235-4aa1-9732-9976b462739d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.481933 Aug 23 22:33:27.889925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 146/290] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:27 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:28.916237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:28.916939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:28.924544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:28.925109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:28.925846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:28.926922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:28.927394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:28.927895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:29.084696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:29.093092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-85f9a56b-b9b6-4014-ad82-de17971c180a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.186495 Aug 23 22:33:29.093676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 145/291] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:28 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:30.120877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:30.120877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:30.124729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:30.125248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:30.125899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:30.126847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:30.127490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:30.128191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:30.314640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:30.325681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1f5b66c4-7648-4ec9-ad90-8c6fff91c19f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.211318 Aug 23 22:33:30.326438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 147/292] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:30 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:30.521672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-888896254", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:30.591582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] validate_networks() for None {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:33:31.226747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:33:31.227168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:33:31.228246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:33:31.228744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:33:31.229238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:33:31.239222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:31.239799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:31.240262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:31.240979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:31.241448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:31.241869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:31.259100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Getting quotas for project 7aa16e85a90f44c4872c92d5db467f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:31.263079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Getting quotas for user 55253e6867224ed78cca27eab3a40b68 and project 7aa16e85a90f44c4872c92d5db467f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:31.274944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:33:31.277269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:33:31.363728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:31.368734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:31.388629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:31.389275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:31.389712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:31.390409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:31.390859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:31.391281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:31.464422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-22deeb73-570d-4d3f-b438-7f528d0ab3eb tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945875 Aug 23 22:33:31.466988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 146/293] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:33:31.480677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b3f64b2-5fe5-4c53-9d61-35938e370a56 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:31.497794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b3f64b2-5fe5-4c53-9d61-35938e370a56 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:31.605348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1b3f64b2-5fe5-4c53-9d61-35938e370a56 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:31.619857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b3f64b2-5fe5-4c53-9d61-35938e370a56 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1214 microversion: 2.1 time: 0.145020 Aug 23 22:33:31.620915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 147/294] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:31 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:31.659684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:31.669146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-daf7ccdc-3bdf-49d6-92ce-19bcef7d151d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.310892 Aug 23 22:33:31.671492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 148/295] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:31 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:32.643863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a8790d2a-f8ed-412c-94d6-a7f3ad60c25a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:32.645119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a8790d2a-f8ed-412c-94d6-a7f3ad60c25a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:32.694559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:32.695463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:32.702761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:32.703656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:32.704079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:32.704974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:32.705641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:32.706862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:32.759054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a8790d2a-f8ed-412c-94d6-a7f3ad60c25a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:32.766198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a8790d2a-f8ed-412c-94d6-a7f3ad60c25a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1214 microversion: 2.1 time: 0.126177 Aug 23 22:33:32.766919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 148/296] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:32 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:32.960834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:32.969033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fb6824ae-b210-49ce-aa71-57766a72713d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.280230 Aug 23 22:33:32.969621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 149/297] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:32 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:33.788502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:33.789218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:33.796273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:33.796755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:33.797220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:33.797907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:33.798356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:33.798773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:33.864045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:33.874581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-31363de6-2863-4379-af0e-3be96c93193f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1218 microversion: 2.1 time: 0.090464 Aug 23 22:33:33.875424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 149/298] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:33 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:33.991418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:33.992376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:33.998550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:33.999130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:33.999686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:34.000453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:34.001001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:34.001563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:34.165872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:34.174733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3a3f88b1-af83-4430-8c02-2fbeae753994 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.187430 Aug 23 22:33:34.175315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 150/299] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:33 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:34.896660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:34.896660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:34.903635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:34.904287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:34.904830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:34.905766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:34.906488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:34.907010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:35.000862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:35.010141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8546ac1e-30cb-463b-a6cd-9cd6a2fa3dce tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1218 microversion: 2.1 time: 0.117903 Aug 23 22:33:35.024554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 150/300] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:34 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:35.198335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:35.199565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:35.207321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:35.208131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:35.208569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:35.209701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:35.210273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:35.210950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:35.417028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:35.426822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-257b9fdc-b12b-4b13-affb-b728fee6f5eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.234215 Aug 23 22:33:35.427433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 151/301] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:35 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:36.031873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:36.032640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:36.043845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.043845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.043845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.043845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.044392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.044392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.130163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:36.141499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1bca4580-3694-4d20-bc05-8eeb47f4ab6c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1210 microversion: 2.1 time: 0.113517 Aug 23 22:33:36.142856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 151/302] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:36 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:36.454655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:36.456852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:36.471362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.474994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.475615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.479799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.479799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.479799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.692197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:36.704350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-16e80d08-06f4-4ecb-86c3-b016bef03a13 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1503 microversion: 2.1 time: 0.257608 Aug 23 22:33:36.720765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 152/303] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:36 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:36.728303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25b234df-91f7-4276-86a0-9350d418a47e"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:36.731021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:36.763422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.768848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.769331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.774990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.776062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.776504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.818423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] HTTP exception thrown: Cannot 'attach_volume' instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 while it is in vm_state rescued Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Request method failure captured: Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/os-volume_attachments HTTP/1.1 Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 74 Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUyoQVblB7pqZQfITadlzM1ri-o-yBZZnpHOwSBS14LZJtwpameZki1LHLRWS_RiuqONW5kqzyPOZXWfmAt082oZI7JQHcoKgokNcz47aJev2t2uXyIJKXsDRZn8m0PFUzDfA_pK2KUA6i4isLigyUO14m7FiuCNBjTB_ozFXTzxuc Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:33:36.820572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4f9539894f147e0912a72a1855d31bc", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ebbf49534a8f41109f51637307270016 Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {"volumeAttachment": {"volumeId": "25b234df-91f7-4276-86a0-9350d418a47e"}} Aug 23 22:33:36.822107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Cannot 'attach_volume' instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 while it is in vm_state rescued Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'server_id': '7ba92e33-0332-41e6-8ae0-edb3db94d4e6', 'body': {'volumeAttachment': {'volumeId': '25b234df-91f7-4276-86a0-9350d418a47e'}}} Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:36.823018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 while it is in vm_state rescued Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:36.824393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:36.825689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:36.825689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:36.825689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 while it is in vm_state rescued Aug 23 22:33:36.825689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:33:36.826664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Returning 409 to user: Cannot 'attach_volume' instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 while it is in vm_state rescued {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:36.827838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a3409b3f-8ca6-463b-9bb1-d19527832d14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104709 Aug 23 22:33:36.828891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 152/304] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:33:36 2022] POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/os-volume_attachments => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 22:33:36.839599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:36.840202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:36.874240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.875106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.876477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:36.877395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:36.878579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:36.879181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:37.168760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:37.178099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:37.198631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:37.199238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:37.199734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:37.201628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:37.204345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:37.211015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:37.339569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d5f319e7-b493-4cf1-87c9-7c2f23bd75bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/action" status: 202 len: 0 microversion: 2.1 time: 0.505332 Aug 23 22:33:37.340784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 153/305] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:33:36 2022] POST /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:33:37.350466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:37.351227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:37.358111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:37.358869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:37.359366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:37.360139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:37.360986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:37.361598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:37.365032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:37.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b75f302f-8b6f-4283-98c6-0e734fe5b4b7 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1266 microversion: 2.1 time: 0.218235 Aug 23 22:33:37.380469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 153/306] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:37 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:37.718196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:37.750502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c5b3e59b-98b9-4786-a51a-1b5fe5ab99aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1511 microversion: 2.1 time: 0.403832 Aug 23 22:33:37.751346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 154/307] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:37 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:37.912953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a2315f76-2d58-40d5-8a06-bee9284d5be6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'create', calling method: .version_select at 0x7f5ed17ae310>, body: {"keypair": {"name": "tempest-keypair-88331809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiBatWMhzkiryUx92Q/ZbBS6WpGgPTPeaeCV3DJJCUkajYYsd8jgZq1xwkarPkFVNj2IwyewITKNSJkG9Y1hW+qnFWsCCUpT0YvCXYBc1+gw8QHSp6QNwVrptbv2nDLbg=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:37.957626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-a2315f76-2d58-40d5-8a06-bee9284d5be6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:37.963763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-a2315f76-2d58-40d5-8a06-bee9284d5be6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for user 3eda1fca08b24727929b63318fd6f13e and project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:38.188393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a2315f76-2d58-40d5-8a06-bee9284d5be6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.577028 Aug 23 22:33:38.188393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 154/308] 10.222.0.73 () {62 vars in 1200 bytes} [Tue Aug 23 22:33:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 578 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 22:33:38.402723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:38.403337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:38.409878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:38.410587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:38.411190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:38.412159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:38.412794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:38.413466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:38.523478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:38.536693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-40d51846-7984-446b-86bb-87a231028f4a tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1272 microversion: 2.1 time: 0.136835 Aug 23 22:33:38.537538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 155/309] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:38 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:38.772664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:38.773298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:38.779613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:38.780094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:38.780522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:38.781235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:38.781682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:38.782095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:38.966041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:38.975566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45bea37e-4320-4113-aa08-a79b18a179d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1511 microversion: 2.1 time: 0.207139 Aug 23 22:33:38.976246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 155/310] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:38 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:39.569123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:39.570006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:39.581750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:39.583246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:39.588065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:39.593298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:39.593802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:39.594247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:39.841162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:39.850501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4db8100-1cf9-4125-b44a-878e57006d9f tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.292730 Aug 23 22:33:39.858149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 156/311] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:39 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:39.997648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:39.998429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:40.006568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:40.007409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:40.008041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:40.009245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:40.009983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:40.010560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:40.178733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:40.181272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:40.196379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-274ae3ff-ddd3-4a90-9344-4c57ed8e55c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1511 microversion: 2.1 time: 0.202955 Aug 23 22:33:40.211333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 156/312] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:39 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:40.874837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:40.875694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:40.888486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:40.889445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:40.890241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:40.892606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:40.893487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:40.894112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:40.929586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:41.222987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:41.225402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:41.244575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:41.245457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:41.247487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:41.249953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:41.250519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:41.251642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:41.253363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:41.413998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:41.432495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-56046a91-7e22-4e2d-baaa-f8d0ba8782c4 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.561825 Aug 23 22:33:41.433976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 157/313] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:40 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:41.574522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:41.588357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-22d5f520-a51a-4693-97a0-ec0abb9f81eb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1511 microversion: 2.1 time: 0.371652 Aug 23 22:33:41.602582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 157/314] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:41 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:42.456264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:42.457324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:42.476705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:42.477231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:42.477670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:42.478379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:42.478828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:42.479249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:42.502354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-987342864", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0519581-2335-4850-af7a-c7665f17e04b"}], "security_groups": [{"name": "tempest-securitygroup--1063561853"}], "key_name": "tempest-keypair-88331809", "user_data": "}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:42.642386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] validate_networks() for [('d0519581-2335-4850-af7a-c7665f17e04b', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:33:42.728985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:42.745997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4c4028f8-3939-4682-be21-187174652645 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.292797 Aug 23 22:33:42.747755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 158/315] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:42 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:42.772516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:42.773890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:42.791437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:42.793673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:42.794239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:42.810467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:42.810467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:42.810467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.085813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:43.099963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6de4db03-1f05-48ef-a5b1-f222b22c5833 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1517 microversion: 2.1 time: 0.337575 Aug 23 22:33:43.100569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 159/316] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:42 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:43.105492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e", "tag": "70de8539-3f93-4189-bd9d-7d923e79b4f9"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:43.123820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:43.128142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:43.128142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.138704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] Creating event network-changed:70de8539-3f93-4189-bd9d-7d923e79b4f9 for instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e on hv-cinder-84254 Aug 23 22:33:43.148699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-ae0a6e4b-c992-430b-96de-fd3e1464d97c req-90afb76e-511a-4a7e-97a6-b4724dd10928 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046577 Aug 23 22:33:43.149472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 160/317] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:43.251465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:33:43.251935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:33:43.252441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:33:43.252974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:33:43.253451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:33:43.310539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:43.311535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:43.312290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.313736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:43.314313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:43.315035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.363267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:43.368667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for user 3eda1fca08b24727929b63318fd6f13e and project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:43.383375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:33:43.385544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:33:43.561442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3397d82d-90a2-4c53-a928-5a7c6ccbde12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.061455 Aug 23 22:33:43.562698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 158/318] 10.222.0.73 () {62 vars in 1188 bytes} [Tue Aug 23 22:33:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 22:33:43.580243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:43.580243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:43.774518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:43.775209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:43.783699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:43.784917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:43.788606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.793989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:43.794619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:43.795134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:43.821046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:43.833517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:43.838981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:43.849152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0d33761a-3817-4a65-acf0-bf28ef421556 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1279 microversion: 2.20 time: 0.272833 Aug 23 22:33:43.863091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 161/319] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1279 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:44.071319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:44.095211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fccced6c-7797-40f6-b804-40517cbfa679 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.324944 Aug 23 22:33:44.113328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 159/320] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:43 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:44.871982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:44.872767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:44.942428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:44.951441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:44.952958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:44.954085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f6ff83a-65ff-4b35-88c3-96eec3f91313 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1279 microversion: 2.20 time: 0.089442 Aug 23 22:33:44.954954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 162/321] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:45.124939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:45.125676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:45.134355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:45.134856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:45.135297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:45.136056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:45.136789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:45.137532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:45.568928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:45.578716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-32ab74d3-aab1-41d8-8798-b71f3620c6c8 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.458760 Aug 23 22:33:45.589593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 160/322] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:45 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:45.979253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:45.979854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:45.981867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=58 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:45.986766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:45.987182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:45.987610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:45.988289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:45.988907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:45.989360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:46.066635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:46.101041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:46.104242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:46.106432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-892f7b6e-204f-4eb2-899d-97cb8854ae23 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1283 microversion: 2.20 time: 0.130833 Aug 23 22:33:46.107608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 163/323] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:46.278532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb040f77-2a04-4e0a-b83a-7f58aa820002 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: .version_select at 0x7f5ed18eb550>, body: {"keypair": {"name": "tempest-keypair-936484238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQqb0/YAZC1lOvQLizwVrLaCdVMQvvHVxl6kG4VdeOrDWEBDeIHRg8wiZjCrQjyRlJ0BKOX5GV01EYFwsA7+h3JSc62X2PH0ThPNO4t2ufGPJN28Uf6fE6Zrv83+samqg=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:46.304604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-cb040f77-2a04-4e0a-b83a-7f58aa820002 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for project f4f9539894f147e0912a72a1855d31bc. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:46.304604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-cb040f77-2a04-4e0a-b83a-7f58aa820002 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for user ebbf49534a8f41109f51637307270016 and project f4f9539894f147e0912a72a1855d31bc. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:46.306645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:46.433628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb040f77-2a04-4e0a-b83a-7f58aa820002 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159065 Aug 23 22:33:46.434232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 161/324] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 22:33:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:46.610707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:46.611329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:46.618033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:46.618529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:46.618971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:46.619865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:46.620463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:46.621099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:46.778191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:46.786836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a522ddde-ab40-4381-bcbb-3bb36d11dff6 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.179553 Aug 23 22:33:46.800820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 164/325] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:46 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:47.137366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:47.138237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:47.147963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.148499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.150139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.150273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.150701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.151120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.277519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:47.307064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:47.308623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:47.316344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-67438337-fb37-426a-b5c1-3cadce623deb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1283 microversion: 2.20 time: 0.182948 Aug 23 22:33:47.319088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 162/326] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:47.826091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:47.826866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:47.836599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.837364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.838239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.839153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.839791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.840401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:48.013200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:48.022072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fc20992e-a7a5-486b-a548-5779d232d9a5 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.213849 Aug 23 22:33:48.022655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 165/327] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:47 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:48.367778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:48.370467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:48.385584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:48.386079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:48.386513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:48.387219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:48.388615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:48.389248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:48.501537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:48.515750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:48.518562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:48.520198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-33059a63-0dce-48cf-9007-c551b7af27d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1331 microversion: 2.20 time: 0.160734 Aug 23 22:33:48.521257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 163/328] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:48.882277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e", "name": "network-vif-plugged", "status": "completed", "tag": "70de8539-3f93-4189-bd9d-7d923e79b4f9"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:48.895027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:48.896493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:48.897184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:48.909922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] Creating event network-vif-plugged:70de8539-3f93-4189-bd9d-7d923e79b4f9 for instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e on hv-cinder-84254 Aug 23 22:33:48.916965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-ffe691c2-9f0f-4d7f-b4f0-237605113735 req-67362470-7a78-4065-82ef-879a24cf1fb6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040361 Aug 23 22:33:48.917990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 166/329] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:49.053401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:49.059656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:49.074155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.075132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.075893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.076907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.077597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.078332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.360553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:49.397295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e258c0a4-433e-428d-bf36-a88bee0d8181 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.355480 Aug 23 22:33:49.401997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 164/330] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:49 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:49.547063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:49.548138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:49.560552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.561082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.561539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.566268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.566816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.574111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.658986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:49.671834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:49.676937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:49.679309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-941448c3-9f4e-4907-bd12-de5a871c5d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1337 microversion: 2.20 time: 0.138921 Aug 23 22:33:49.681556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 167/331] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:50.426390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:50.429335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:50.439064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.439728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.440405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.441314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.441874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.442753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.488213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-878022282", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "604e815b-4af0-46a7-bceb-7b7ccb3f41e0"}], "security_groups": [{"name": "tempest-securitygroup--484857656"}], "key_name": "tempest-keypair-936484238", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:50.629145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.640140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-610bd49c-3332-4508-8802-102dfa076797 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.220894 Aug 23 22:33:50.640971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 165/332] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:50 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:50.693790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] validate_networks() for [('604e815b-4af0-46a7-bceb-7b7ccb3f41e0', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:33:50.721366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:50.724504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:50.740632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.742032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.743236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.744886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.746783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.757332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.956415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.966300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.967832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.968962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dac124de-af84-4f9b-aca8-134fca4345a0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.258081 Aug 23 22:33:50.969594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 166/333] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:51.663280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:51.664400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:51.682622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:33:51.683662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:33:51.684623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:33:51.685681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:33:51.686273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:33:51.701768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.703075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.704079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.705634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.708312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.710368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.719451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.724592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.727486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.729290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.730079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.730798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.798094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:51.806450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Getting quotas for user ebbf49534a8f41109f51637307270016 and project f4f9539894f147e0912a72a1855d31bc. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:51.828630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:33:51.831054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:33:51.926811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:51.935961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-46ba9516-2ea4-45d2-a982-7014b4cb2297 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1314 microversion: 2.1 time: 0.276565 Aug 23 22:33:51.936546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 167/334] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:51 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:51.942132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:51.954913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.954913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.954913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.967589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] Creating event network-changed:5c6bb5ba-892a-4226-aaf9-01d9d08525ab for instance e4822c04-cfe2-4f63-b2db-42c5011791cc on hv-cinder-84254 Aug 23 22:33:51.974463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-9d1f8372-e2bd-4193-a41a-0691fe295797 req-68df09f2-3d5e-4e11-b823-2adc0f73f92c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034624 Aug 23 22:33:51.975172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 168/335] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:51.993175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:51.993893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:52.000310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.001240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.001701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.002429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.002884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.003307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.024107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4e590a8-e414-454c-a3d1-f98ee922e779 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.539862 Aug 23 22:33:52.024366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 168/336] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:33:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:33:52.036863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d1f3ad9-5d03-4f93-b961-0b2366cb9947 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:52.037930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d1f3ad9-5d03-4f93-b961-0b2366cb9947 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:52.110323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d1f3ad9-5d03-4f93-b961-0b2366cb9947 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.119678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d1f3ad9-5d03-4f93-b961-0b2366cb9947 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1244 microversion: 2.1 time: 0.086322 Aug 23 22:33:52.121357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 169/337] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:52.222121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.240555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.245328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.260263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f880ddc0-3ac6-4b66-b8f3-5526158d2599 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.271895 Aug 23 22:33:52.263458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 169/338] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:51 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:52.960067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:52.961205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:52.968343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.968852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.969299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.969993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.970441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.971251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.142252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-083f41ef-c510-42b6-b05e-6455a6c4018e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.142806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-083f41ef-c510-42b6-b05e-6455a6c4018e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:53.207055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-083f41ef-c510-42b6-b05e-6455a6c4018e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.214711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.222492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-083f41ef-c510-42b6-b05e-6455a6c4018e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1244 microversion: 2.1 time: 0.084316 Aug 23 22:33:53.223075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 170/339] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:53.235929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a574c8e-9b48-4aed-8bdc-95d67c143b3c tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1464 microversion: 2.1 time: 0.274197 Aug 23 22:33:53.235929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 170/340] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:52 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:53.285790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.293363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:53.301024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.302086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:53.308865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.313568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.314060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.314503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.315194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.315937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.316422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.316853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.322780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.324212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.324655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.325127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.346084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:53.359160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:33:53.569824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.580939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.582494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.584036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f2cc197-de6b-4713-995f-c12f36d15db6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.302245 Aug 23 22:33:53.584783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 171/341] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:53.797328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-11fed3dc-1e87-4ce9-acc1-bcdd746350b1 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 204 len: 0 microversion: 2.1 time: 0.499882 Aug 23 22:33:53.798019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 171/342] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:33:53 2022] DELETE /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:33:53.807178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.807794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:53.823976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.823976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.823976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.823976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.824333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.824333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.962458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.971225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-780aebe1-39bd-496f-8af1-7d7892134d17 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1470 microversion: 2.1 time: 0.167947 Aug 23 22:33:53.971795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 172/343] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:53 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:54.244449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:54.245304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:54.252975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.253601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.254108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.255307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.256297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.256725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.329718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:54.339195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ac828f4a-42f8-4dbd-9e59-4e8e21d7e5a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1240 microversion: 2.1 time: 0.099185 Aug 23 22:33:54.353268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 172/344] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:54.610292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:54.610889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:54.617084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.617573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.618215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.618912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.619362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.619779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.754134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:54.762855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:54.764344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:54.765467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b8292caf-3aad-4ce3-910e-ffb214a77ac4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.159144 Aug 23 22:33:54.766022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 173/345] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:54.995180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:54.996105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:55.003117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.003504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.003948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.005285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.005911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.006349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.142204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.150936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-18e9f962-e181-439d-8b93-f1e1d352ac1d tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1470 microversion: 2.1 time: 0.160095 Aug 23 22:33:55.151499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 173/346] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:54 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:55.363585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:55.364543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:55.375150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.375864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.376318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.379934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.379934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.380333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.457255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.465511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-73303836-cf20-4544-b625-175ed51c2baf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1240 microversion: 2.1 time: 0.107286 Aug 23 22:33:55.466091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 174/347] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:55.789114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:55.790109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:55.802316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.803142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.803934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.805424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.806094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.806933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.954031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.963602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.965141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.966323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eca7d67d-a8f4-450e-b70d-7273af7c5aa0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.182195 Aug 23 22:33:55.966894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 174/348] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:56.173875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:56.174518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:56.181528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.182025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.182465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.183165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.183620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.184046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.489031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:56.489363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:56.498726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.499223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.500061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.501308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.501933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.502719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.507218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:56.525574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1e1cb4b9-3b88-4827-a085-df31c9354d93 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1470 microversion: 2.1 time: 0.354922 Aug 23 22:33:56.525776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 175/349] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:56 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:56.547297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:56.618480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:56.626353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8247b76f-86ff-4449-9f14-4cc049fe81f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1240 microversion: 2.1 time: 0.143133 Aug 23 22:33:56.627184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 175/350] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1240 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:56.991156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:56.991774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:56.998052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.998539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.998972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.999677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.000127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.000563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.187614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.197188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.198673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.199800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d148b1ff-a4fa-4b1a-8351-60f684a6daa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.213535 Aug 23 22:33:57.200238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 176/351] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:57.546997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:57.547630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:57.556238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.556918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.557622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.558233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.559350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.559350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.650058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:57.673943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:57.697515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.698035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.698629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.699552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.700011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.700575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.720251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.730368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-43c95b30-e87e-4916-be73-96f6ff02d768 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1470 microversion: 2.1 time: 0.187528 Aug 23 22:33:57.734864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 176/352] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:57 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:57.786559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.794233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-de0257b1-91fc-4147-bb2a-76dbbf2cf770 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1240 microversion: 2.1 time: 0.150740 Aug 23 22:33:57.794800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 177/353] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:58.229828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:58.230426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:58.237072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.237562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.237986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.238750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.239349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.239770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.493692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.502775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.505600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.506908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b557cedb-ec4f-47ac-a911-160f5e820d76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.281085 Aug 23 22:33:58.507630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 177/354] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:58.764796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:58.765621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:58.772991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.775052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.775599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.777810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.779415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.780043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.818692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:58.820048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:58.850771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.851276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.851761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.852482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.852960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.853395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.982365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.993994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0dde269c-64a9-4caa-ad20-4d8ff40160ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1296 microversion: 2.1 time: 0.180423 Aug 23 22:33:58.998515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 178/355] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1296 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:59.161491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e", "name": "network-vif-deleted", "tag": "70de8539-3f93-4189-bd9d-7d923e79b4f9"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:59.178495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.180803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.182008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.195098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.196780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] Creating event network-vif-deleted:70de8539-3f93-4189-bd9d-7d923e79b4f9 for instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e on hv-cinder-84254 Aug 23 22:33:59.202952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-b1bbf3b2-f426-41d3-99df-b1878b2fa14b req-49539e94-a24e-4bca-9356-268fa20f7127 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048136 Aug 23 22:33:59.212314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 179/356] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:59.212994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ff9d683b-6438-46ff-9abb-40e6a5e919e0 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1470 microversion: 2.1 time: 0.448771 Aug 23 22:33:59.212994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 178/357] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:58 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:59.530629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:59.531337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:59.538619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.545904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.545904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.545904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.545904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.546306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.744045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.756819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.758702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.759863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be3dff27-31f9-47b2-a3a8-e98947899324 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.233908 Aug 23 22:33:59.760425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 180/358] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:34:00.036410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:00.037090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:00.058481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.061501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.069786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.079303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.079303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.079303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.079303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:00.215700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:00.228131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-48d3d63a-cb2f-41f5-988f-4d36ec1655de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1302 microversion: 2.1 time: 0.214019 Aug 23 22:34:00.228708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 179/359] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:00.231996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:00.232626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:00.246822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.247334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.247780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.248532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.249040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.249512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.305177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.306435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.307062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.311165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lazy-loading 'fault' on Instance uuid 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:34:00.368460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55253e6867224ed78cca27eab3a40b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa16e85a90f44c4872c92d5db467f3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:00.390687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-58771e29-3f68-4aab-85f8-a86e6a9841fc tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 200 len: 1304 microversion: 2.1 time: 0.162994 Aug 23 22:34:00.391706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 181/360] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:00 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:00.782373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:00.782982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:00.791834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.792594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.793332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.794418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.795053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.795472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.267651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:01.279999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:01.300796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:01.304381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:01.305231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.308204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:01.309839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:01.310635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.570754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:01.587289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:01.590956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:01.594832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-840b29eb-c07f-47dc-9b94-0df4c0b60140 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.816291 Aug 23 22:34:01.597034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 180/361] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:34:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:34:01.606909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:01.613065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] [instance: 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:01.630159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:01.631116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:01.632340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.635812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:01.636643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:01.637589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.682113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] HTTP exception thrown: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Request method failure captured: Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e HTTP/1.1 Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVW2knzIWVAAf3U0amYXl8dGW0hc03DZArZVYXZyTsVGj4Wt-ML38XqL8-QnIjOBebSdwtmZ8bOZqsKe_ARNO52E0DV9zqX9rUWValtHAztunhxGxX5w6PZgqU8uV3n4r7cbZKuJX6-XPlNUfa9Ee-Fx_qfY4Z-073l7QDwIL68wSyA Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 7aa16e85a90f44c4872c92d5db467f3e Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesNegativeTest-1572028605 Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:34:01.686419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7aa16e85a90f44c4872c92d5db467f3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7aa16e85a90f44c4872c92d5db467f3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7aa16e85a90f44c4872c92d5db467f3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7aa16e85a90f44c4872c92d5db467f3e", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesNegativeTest-1572028605 Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 7aa16e85a90f44c4872c92d5db467f3e Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesNegativeTest-1572028605 Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesNegativeTest-1572028605-project Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 55253e6867224ed78cca27eab3a40b68 Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesNegativeTest-1572028605-project Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. Aug 23 22:34:01.688022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e'} Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:34:01.688757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. Aug 23 22:34:01.690000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:01.695370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] Returning 404 to user: Instance 4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:34:01.695370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b1272df6-2f3f-4fa3-b738-577542a67b54 tempest-VolumesNegativeTest-1572028605 tempest-VolumesNegativeTest-1572028605-project] 10.222.0.73 "GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e" status: 404 len: 111 microversion: 2.1 time: 0.090672 Aug 23 22:34:01.695370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 181/362] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:01 2022] GET /compute/v2.1/servers/4abb8338-02bc-4a4c-89e2-bc55ce8b7e9e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:34:01.759525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "name": "network-vif-plugged", "status": "completed", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:01.772970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:01.775720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:01.776458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:01.777111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.819954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] Creating event network-vif-plugged:5c6bb5ba-892a-4226-aaf9-01d9d08525ab for instance e4822c04-cfe2-4f63-b2db-42c5011791cc on hv-cinder-84254 Aug 23 22:34:01.835221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-0a820d40-30f6-4e6f-bfb8-712d64d42e70 req-557cd7f5-78a2-4d78-a2e2-1e3cd9615534 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080626 Aug 23 22:34:01.837548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 182/363] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:02.030761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.040638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ff66420d-18f6-419e-89a8-70df4cbec881 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.790067 Aug 23 22:34:02.042231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 182/364] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:02.621243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=12 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:02.637048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:02.639980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:02.649989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.651506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.652290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.653393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.654013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.654606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.954111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.972890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.979751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.982812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-702e1953-1b44-4a81-8469-2f9238e50b1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.361071 Aug 23 22:34:02.993209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 183/365] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:34:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:34:03.063965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:03.065241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:03.075813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.076695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.077490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.078523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.079341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.080261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.194436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:03.206941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.208706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.209712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.226018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] Creating event network-changed:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:34:03.227507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=26 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:03.232359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-24326cd9-1f7d-47f6-89a4-7956b69aee64 req-e5b13be6-45c0-4563-8432-4495130f16cb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042049 Aug 23 22:34:03.233744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 184/366] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:03.299804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:03.309832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8371b63e-55ee-4987-a43f-70fbc97ca936 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.249152 Aug 23 22:34:03.311829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 183/367] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:04.009815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:04.015518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:04.018578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.019078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.019515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.021204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.021771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.022203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.325446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:04.334585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:04.334585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:04.343742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.344391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.345199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.347910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.347910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.347910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.348982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:04.350565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:04.351736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9ef6d289-a509-4d1b-abf2-09d84480e12b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1405 microversion: 2.20 time: 0.347589 Aug 23 22:34:04.365280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 185/368] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:34:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:34:04.572119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:04.578239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-82721837-a59a-48e4-a9d7-13ebcfb23c4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.250039 Aug 23 22:34:04.578826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 184/369] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:05.375652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:05.376214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:05.382895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.383385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.383824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.384529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.384983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.385463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.589500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:05.597452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:05.600499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:05.601953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-037c5c1d-f383-4ff5-bf3b-0913cfa555b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1598 microversion: 2.20 time: 0.230555 Aug 23 22:34:05.602839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 186/370] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:34:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1598 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:34:05.625285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:05.626791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:05.632010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:05.632260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:05.640159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.641055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.641782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.643593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.645791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.651423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.657944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.661140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.662071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.663429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.665488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.666244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.764155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f31cfa47-1928-4518-8990-00746832c4b9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141500 Aug 23 22:34:05.765533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 187/371] 10.222.0.73 () {60 vars in 1316 bytes} [Tue Aug 23 22:34:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:34:05.920771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:05.934965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6d73965b-f621-42a7-80a4-15d73b81f61f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.337823 Aug 23 22:34:05.936035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 185/372] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:06.956274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:06.957500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:06.964352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:06.965336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:06.965336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:06.965989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:06.966442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:06.967278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.438567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:07.456232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ef42d3df-c479-4821-a962-a557a8548c81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.504002 Aug 23 22:34:07.456981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 188/373] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:07.818739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:07.829984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:07.839948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:07.839948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.847266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] Creating event network-changed:5c6bb5ba-892a-4226-aaf9-01d9d08525ab for instance e4822c04-cfe2-4f63-b2db-42c5011791cc on hv-cinder-84254 Aug 23 22:34:07.853801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-eacf23e5-d6fc-42a7-be93-67827422aaa6 req-c25e1780-9514-4cb1-bf98-23fb1dd5936f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039534 Aug 23 22:34:07.855051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 186/374] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:08.480557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:08.481364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:08.488735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.489719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.490257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.491033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.491694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.492296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.732096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:08.746976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-54994274-e01d-405b-9646-12dd34ec9d03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.269349 Aug 23 22:34:08.746976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 189/375] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:09.768598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:09.770225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:09.777672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:09.779040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:09.779683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:09.780718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:09.781390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:09.782481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:09.937164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:09.946257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-281843e7-f38b-4f66-a60d-715b70bd5cbc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.182632 Aug 23 22:34:09.946828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 187/376] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:10.967827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:10.968545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:10.976329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.976822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.977347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:10.978048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.978500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.978955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:11.170179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:11.182335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-306cdaa6-1ff9-424d-bdf8-32776606c09c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.218179 Aug 23 22:34:11.183274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 190/377] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:12.204928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:12.205566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:12.212010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.212515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.216130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:12.216130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.216130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.216130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:12.515410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:12.524081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8cd00bf-936e-4818-a408-962342613131 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.322824 Aug 23 22:34:12.525765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 188/378] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:13.546215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:13.546979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:13.554139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:13.554632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:13.555068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:13.555769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:13.556219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:13.556640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:13.723093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:13.741534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb1161d2-380e-43d9-b3b1-046a41eb1356 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.198953 Aug 23 22:34:13.749630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 191/379] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:14.764130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:14.764817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:14.773175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.776018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.776662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.777796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.778415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.779038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.851027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1802764981", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "networks": [{"uuid": "6bb59ad9-6c99-4ab5-b6e7-8ef6d02d4d80"}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:14.913287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] validate_networks() for [('6bb59ad9-6c99-4ab5-b6e7-8ef6d02d4d80', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:34:14.931526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:14.940076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4358919-6881-4220-a535-ebed4e8a4d9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.179765 Aug 23 22:34:14.940710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 189/380] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:15.375435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:34:15.376121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:34:15.376663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:34:15.377368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:34:15.381918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:34:15.403467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.404088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.404617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.405461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.420032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.420032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.426397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Getting quotas for project 0fb8b4774d54411099bec473966aced5. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:34:15.430956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Getting quotas for user e037a0abf77f45d7befabbf8d05fcd53 and project 0fb8b4774d54411099bec473966aced5. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:34:15.443056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:34:15.445352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:34:15.615584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ab77c538-a68b-47e8-9a21-47cb1bcea41b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768967 Aug 23 22:34:15.623944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 192/381] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:34:15.633547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2a0370c0-4e38-46e1-a8f1-0e063c421a88 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:15.637871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2a0370c0-4e38-46e1-a8f1-0e063c421a88 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:15.711566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "name": "network-vif-plugged", "status": "completed", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:15.724774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a0370c0-4e38-46e1-a8f1-0e063c421a88 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:15.732814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2a0370c0-4e38-46e1-a8f1-0e063c421a88 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1214 microversion: 2.1 time: 0.106919 Aug 23 22:34:15.733141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.747139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 190/382] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:15 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:15.748561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.749075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.761807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] Creating event network-vif-plugged:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:34:15.767736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-4c90745c-43e4-4bf7-bbe8-5743b61b1fc9 req-b67b1372-6875-4acd-a51d-616fa881fd3c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061440 Aug 23 22:34:15.768323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 193/383] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:15.962280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:15.962910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:15.972321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.981996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.981996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.981996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.981996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.982413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:16.231358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:16.239820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4aa2992-9425-4c5c-af9a-27e28861b0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.281326 Aug 23 22:34:16.240391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 191/384] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:16.756523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a6f7176-7482-49de-ae84-018059966baa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:16.757261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a6f7176-7482-49de-ae84-018059966baa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:16.828415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a6f7176-7482-49de-ae84-018059966baa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:16.836736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a6f7176-7482-49de-ae84-018059966baa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1214 microversion: 2.1 time: 0.085111 Aug 23 22:34:16.841191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 194/385] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:16 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:17.261533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:17.262468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:17.270216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.270571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.271227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:17.271991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.272466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.272925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:17.451681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:17.460440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fcd6ca7c-099b-47a3-97e8-1260c2c2d75b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1369 microversion: 2.1 time: 0.203297 Aug 23 22:34:17.461136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 192/386] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:17.866334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:17.866334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:17.866334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:17.868803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.869486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.869928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:17.870665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.871076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.871500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:17.944955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:17.953356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b1cde5d9-0815-4055-8044-0c0de3860ca5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1218 microversion: 2.1 time: 0.098412 Aug 23 22:34:17.954100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 195/387] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:17 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:18.494708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:18.496154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:18.503851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.504644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.505396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.506111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.506567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.506993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.703223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:18.707402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:18.720445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-12d7493f-f842-40ec-9cdc-6c5654be8ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1564 microversion: 2.1 time: 0.240978 Aug 23 22:34:18.721811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 193/388] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1564 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:18.760947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:18.761545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:18.770244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.774299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.774299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.774299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.774299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.775019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.857845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a3678e17-2857-431f-b4b7-a7492e4d6105 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106540 Aug 23 22:34:18.858475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 196/389] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 22:34:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:18.977333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:18.977997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:18.984310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.984812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.985342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.985978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.986434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.986858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:19.055230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:19.064065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a1a4d315-0307-4cca-8db7-4cab02ade0e0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1266 microversion: 2.1 time: 0.091862 Aug 23 22:34:19.064787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 194/390] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:18 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:19.250066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-345963979", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "networks": [{"uuid": "2e17aefa-e764-443a-85d5-ebcc09185e13"}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:19.310260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] validate_networks() for [('2e17aefa-e764-443a-85d5-ebcc09185e13', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:34:19.933502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:34:19.934369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:34:19.935261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:34:19.935791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:34:19.936602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:34:19.947338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:19.947993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:19.948539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:19.949481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:19.949946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:19.950487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:19.968989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Getting quotas for project 182b0a6a36fb4c14816d9f94b270686c. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:34:19.974522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Getting quotas for user adc12894a7c94ae1b06340353fd99654 and project 182b0a6a36fb4c14816d9f94b270686c. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:34:19.989166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:34:19.991890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:34:20.085941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:20.086838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:20.095217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:20.095873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:20.099637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:20.101566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:20.102207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:20.102872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:20.213262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0405905e-de1b-405c-bd97-92f8a67b5cbe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967381 Aug 23 22:34:20.214997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 197/391] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:34:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:34:20.236582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1492e391-c80d-405f-b9c2-1399db71b93a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:20.237382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1492e391-c80d-405f-b9c2-1399db71b93a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:20.252881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:20.272377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-00153636-efd4-4503-87cb-ede1a0cf50c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1284 microversion: 2.1 time: 0.190476 Aug 23 22:34:20.276795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 195/392] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:20 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:20.575413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1492e391-c80d-405f-b9c2-1399db71b93a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:20.586429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1492e391-c80d-405f-b9c2-1399db71b93a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1218 microversion: 2.1 time: 0.361373 Aug 23 22:34:20.587233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 198/393] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:20 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:20.678994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:20.690858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:20.695751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:20.696289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:20.701194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:20.709463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] Creating event network-changed:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:34:20.715055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-a1ea6840-561f-43e8-a060-50d77c3084a4 req-ba81dd6c-94d9-4c17-843e-b4cad86f4231 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039875 Aug 23 22:34:20.715590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 196/394] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:21.294931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:21.295870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:21.307445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:21.307953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:21.308395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:21.309133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:21.309594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:21.310018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:21.469974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:21.478297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-66015f28-6ec2-490d-a53f-7d76f7414f14 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.187078 Aug 23 22:34:21.479054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 199/395] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:21 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:21.609264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a062610e-b510-465a-961a-3ea4f085cab1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:21.610599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a062610e-b510-465a-961a-3ea4f085cab1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:21.725274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a062610e-b510-465a-961a-3ea4f085cab1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:21.735928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a062610e-b510-465a-961a-3ea4f085cab1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1218 microversion: 2.1 time: 0.130021 Aug 23 22:34:21.750562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 197/396] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:21 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:22.506257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:22.507540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:22.513872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:22.514593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:22.515191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:22.516051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:22.523708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:22.523708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:22.530389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda9ce75-705d-444e-b1c3-4dd751cadd50", "tag": "b9706a3b-2f07-4b24-a2ef-d59825d4789a"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:22.554069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:22.554903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:22.555532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:22.581046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] Creating event network-changed:b9706a3b-2f07-4b24-a2ef-d59825d4789a for instance fda9ce75-705d-444e-b1c3-4dd751cadd50 on hv-cinder-84254 Aug 23 22:34:22.600164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-1ef88245-bcbc-48c2-aade-27011cf27632 req-2aeb7497-c1f7-46ee-8467-494082fc6408 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073714 Aug 23 22:34:22.602651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 198/397] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:22.684003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:22.692069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b78025d6-d067-4c02-9d50-99733d165118 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.189642 Aug 23 22:34:22.692657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 200/398] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:22 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:22.763061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:22.763800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:22.770853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:22.771345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:22.771781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:22.772492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:22.772942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:22.773399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:22.895885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:22.907561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e485cd96-dfe3-40f9-8f87-2b6be67f172c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1214 microversion: 2.1 time: 0.149279 Aug 23 22:34:22.911018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 199/399] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:22 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:23.716221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:23.718598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:23.725697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:23.726325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:23.726760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:23.727477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:23.728124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:23.728539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:23.868339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:23.877219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34a65c31-6c7f-4779-84c3-029d52757983 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.168143 Aug 23 22:34:23.879459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 201/400] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:23 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:23.932734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:23.933666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:23.940236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:23.940725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:23.941886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:23.942900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:23.948287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:23.948287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:24.009534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:24.017582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-861a20c7-2e15-4061-9db3-1459ce3b97e8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1270 microversion: 2.1 time: 0.089060 Aug 23 22:34:24.018151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 200/401] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:23 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:24.899147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:24.899751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:24.905869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:24.906399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:24.906863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:24.907551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:24.908005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:24.908463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:24.926022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:25.039403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:25.040051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:25.047226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:25.047762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:25.048197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:25.048937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:25.049472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:25.049833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:25.057202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:25.065111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8cd3647d-bb5d-4ef4-ad54-e2422aee5457 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.169963 Aug 23 22:34:25.066423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 202/402] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:24 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:25.117541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:25.125822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-df1c36b1-6ff4-42ce-9da6-979545d3c1f2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1278 microversion: 2.1 time: 0.091693 Aug 23 22:34:25.126380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 201/403] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:25 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:25.666977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:25.667500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:25.673975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:25.674299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:25.674737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:25.676203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:25.676916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:25.677372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:25.702515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-21c2e39a-ad25-4cb2-9d46-3f2dd7af740a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/ips" status: 200 len: 145 microversion: 2.1 time: 0.039459 Aug 23 22:34:25.703198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 203/404] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:34:25 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:26.088683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:26.089319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:26.096243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:26.096724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:26.097677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:26.098801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:26.099309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:26.099737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:26.151627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:26.152911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:26.159333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:26.160449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:26.160906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:26.161644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:26.162233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:26.162509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:26.228042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:26.235908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c09f9b39-ca8e-4897-bd0c-1321e8329701 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1278 microversion: 2.1 time: 0.088809 Aug 23 22:34:26.236687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 204/405] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:26 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:26.247025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:26.255179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45e2789e-efc9-4b6a-a5be-5e9ef2dd0c0b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.170320 Aug 23 22:34:26.261096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 202/406] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:26 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:27.258182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:27.258833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:27.266418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:27.269430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:27.269430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:27.269430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:27.269430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:27.270003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:27.280299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:27.281249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:27.296429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:27.297248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:27.297732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:27.298581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:27.299103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:27.299728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:27.420413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:27.429727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8685e2a1-00ce-43b3-b36d-2072bf41c599 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.176322 Aug 23 22:34:27.430403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 205/407] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:27 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:27.477407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:27.487123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-28da896a-8446-407b-89ed-bb45559047f2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.210913 Aug 23 22:34:27.498623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 203/408] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:27 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:28.451200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:28.451919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:28.458312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:28.458801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:28.459239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:28.459942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:28.460432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:28.460856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:28.508355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:28.509725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:28.520510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:28.520510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:28.520510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:28.520510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:28.521303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:28.521303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:28.632962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:28.641077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-01d7b664-a7d2-4f68-809c-493ddd9d63e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.193875 Aug 23 22:34:28.641656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 206/409] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:28 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:28.741821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:28.761822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-56c61505-c557-4d5b-935d-58bd4037fe41 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.257031 Aug 23 22:34:28.765844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 204/410] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:28 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:28.918003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd", "tag": "ea342964-7d30-4741-9e4d-2f9b0e9a2a39"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:28.928877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:28.929410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:28.929953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:28.942114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] Creating event network-changed:ea342964-7d30-4741-9e4d-2f9b0e9a2a39 for instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd on hv-cinder-84254 Aug 23 22:34:28.948514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-8fb13900-633b-4ab3-bea4-9a82e5899519 req-cf62626a-8421-493d-91a1-c6e155154957 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Aug 23 22:34:28.949853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 207/411] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:29.663095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:29.663710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:29.670503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:29.670987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:29.671418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:29.672117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:29.672596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:29.673076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:29.792503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:29.793719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:29.800691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:29.801363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:29.801974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:29.802777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:29.803544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:29.804276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:29.806999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:29.817052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ededab3c-8f0c-4943-8fff-690df12c18f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.157002 Aug 23 22:34:29.817719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 205/412] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:29 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:29.823063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda9ce75-705d-444e-b1c3-4dd751cadd50", "name": "network-vif-plugged", "status": "completed", "tag": "b9706a3b-2f07-4b24-a2ef-d59825d4789a"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:29.834970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:29.834970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:29.835190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:29.849957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] Creating event network-vif-plugged:b9706a3b-2f07-4b24-a2ef-d59825d4789a for instance fda9ce75-705d-444e-b1c3-4dd751cadd50 on hv-cinder-84254 Aug 23 22:34:29.855091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-29167de7-47fc-4537-b2ba-b670a305b1f8 req-1f5c1d65-3c80-4a36-9332-380c89a9fb66 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Aug 23 22:34:29.855669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 206/413] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:29.954959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:29.959265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=4 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:29.964052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3cf4f1f6-34e3-467f-8bbf-6c406660ccb3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.175946 Aug 23 22:34:29.964653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 208/414] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:29 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:30.839903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:30.840624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:30.847265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:30.853243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:30.853243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:30.853243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:30.853243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:30.853822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:30.985910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:30.986511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:30.988922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=16 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:30.993811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:30.994293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:30.994745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:30.995431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:30.995872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:30.996378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:31.003101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:31.012988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c55cb059-72f1-443b-b24b-0be0cc9efe47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.177595 Aug 23 22:34:31.027718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 207/415] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:30 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:31.143177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:31.152582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cbb4eddf-7d17-4c25-b48c-f9960d39f73c tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.170421 Aug 23 22:34:31.153175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 209/416] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:30 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:32.035806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:32.036457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:32.038440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:32.043753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:32.044296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:32.044698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:32.045475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:32.045921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:32.046350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:32.173110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:32.174719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:32.181295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:32.188314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:32.188967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:32.189555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:32.190172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-04180326-da66-48c0-8505-5017ec9c0069 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.158621 Aug 23 22:34:32.190564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:32.191146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:32.191262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 208/417] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:32 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:32.191838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:32.325842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:32.334148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-20bf491f-6408-4c1e-a923-e2d43c60a1dd tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.164868 Aug 23 22:34:32.334707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 210/418] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:32 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:33.177029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:34:33.177670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:34:33.211997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:33.212610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:33.219775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:33.220256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:33.221098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:33.221385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:33.221912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:33.222333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:33.355373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:33.355981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:33.362071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:33.362586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:33.363017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:33.364623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:33.365188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:33.365616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:33.365805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:33.373902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f073ba67-7902-43e3-a59f-e9d67e41ef84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.166088 Aug 23 22:34:33.374473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 209/419] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:33 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:33.502320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:33.510538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-711fc660-b440-471b-906b-109549ad34c8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.159115 Aug 23 22:34:33.511148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 211/420] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:33 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:34.398040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:34.398774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:34.405256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:34.405744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:34.406181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:34.406913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:34.407368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:34.407792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:34.531508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:34.533870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:34.538812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:34.539301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:34.539766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:34.540438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:34.540574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:34.540894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:34.542056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:34.549450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2de5b514-e26a-4524-8099-0f27fde38833 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.156106 Aug 23 22:34:34.550394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 210/421] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:34 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:34.684293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:34.692415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-50b1bd2b-ece9-4072-9316-6c124c02e60d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.164716 Aug 23 22:34:34.692955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 212/422] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:34 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:35.463554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b955777e-7293-4aa9-8f59-b6c3b8adffc7"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:35.465912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:35.472616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.473293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.473918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.475014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.475476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.475897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.570607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:35.576484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:35.577237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.577723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.578162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.578871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.579321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.579743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.719867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:35.729083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c82886ad-e645-4922-9c70-68b768627458 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.162479 Aug 23 22:34:35.731431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 213/423] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:35 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:35.734758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:35.735345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:35.742268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.742752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.743179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.743869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:35.744314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:35.744728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:35.892660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:35.902185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f81b98f-fad6-4147-b90e-2c1dac32d74d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.171564 Aug 23 22:34:35.902753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 214/424] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:35 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:36.751879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:36.752546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:36.758642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:36.759131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:36.759559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:36.760241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:36.760684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:36.761171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:36.890380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:36.899433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d20d3424-e0c9-4e50-915a-6ec3edec5063 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.151371 Aug 23 22:34:36.899904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 215/425] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:36 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:36.923048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:36.923655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:36.929654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:36.930129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:36.930553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:36.931226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:36.931695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:36.932107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:37.070318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:37.078043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f7aafde-8c5a-42a7-96a4-c2ce4ae877aa tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.158718 Aug 23 22:34:37.078605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 216/426] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:36 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:37.921371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:37.922039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:37.927920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:37.928409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:37.929482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:37.930296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:37.930749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:37.931179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:38.062804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:38.070618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42dd897d-d6d8-4320-9a7e-a7fffabfcfb5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.153261 Aug 23 22:34:38.071054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 217/427] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:37 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:38.099620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:38.100226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:38.107099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:38.107582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:38.108017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:38.108705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:38.109196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:38.109626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:38.237212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:38.245137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fb5425d2-95b3-4e29-9370-c6566d49d822 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.149297 Aug 23 22:34:38.245731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 218/428] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:38 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:39.091929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:39.092661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:39.099462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:39.099983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:39.100510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:39.101672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:39.101842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:39.102302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:39.239685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:39.248270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb01b4e0-8e37-43df-8c57-4926b421433a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.160051 Aug 23 22:34:39.248696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 219/429] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:39 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:39.266841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:39.267439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:39.273748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:39.274230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:39.274664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:39.275357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:39.275808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:39.276247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:39.278909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:39.421232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:39.430103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a3e95a15-095f-4deb-9d71-7df20ca5d2a8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.167521 Aug 23 22:34:39.430663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 220/430] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:39 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:40.270728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:40.271622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:40.277436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:40.277920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:40.278391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:40.279076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:40.279522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:40.279942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:40.415109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:40.422917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-27e3ff9e-e85d-40a9-920b-1fca462174d6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.156267 Aug 23 22:34:40.423479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 221/431] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:40 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:40.452039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:40.452650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:40.458993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:40.459480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:40.460414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:40.461137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:40.461599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:40.462022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:40.594071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:40.602634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9966979a-d28b-41e5-8878-e7b500b24bd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.154608 Aug 23 22:34:40.609641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 222/432] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:40 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:41.444698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:41.445670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:41.451740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:41.452217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:41.452648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:41.453367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:41.453817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:41.454236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:41.590173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:41.598242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4c74b05-adcb-483f-ab29-b45305e889b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.158014 Aug 23 22:34:41.598816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 223/433] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:41 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:41.627931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:41.630817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:41.634699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:41.635189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:41.635628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:41.636317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:41.636768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:41.637225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:41.772120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:41.785578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-44afa533-1b20-4e56-b31a-85374cd0091d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.155897 Aug 23 22:34:41.785578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 224/434] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:41 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:42.623732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:42.627816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:42.643923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:42.644822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:42.645283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:42.645978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:42.646429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:42.646860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:42.792550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:42.799356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07e1003f-3f6e-4706-8007-bcf3ce32055b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.181002 Aug 23 22:34:42.800096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 225/435] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:42 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:42.805469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:42.806085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:42.812317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:42.812814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:42.813397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:42.814121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:42.814598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:42.815023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:42.963938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:42.972029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-80667787-b442-489c-967a-8c7a6f660a4d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.170944 Aug 23 22:34:42.972615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 226/436] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:42 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:43.469381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cdf85d78-279c-494f-a2f3-a924eb7b1d0d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.004771 Aug 23 22:34:43.469381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 211/437] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:34:35 2022] POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments => generated 194 bytes in 8007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:43.821926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:43.822540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:43.828973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:43.829485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:43.829910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:43.830645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:43.831084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:43.831498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:43.962614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:43.970501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fb7e4d01-505c-4664-9b75-963fe7278899 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.153200 Aug 23 22:34:43.971084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 227/438] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:43 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:43.993740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:43.994539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:44.001143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:44.001676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:44.002042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:44.002717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:44.003164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:44.003575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:44.006185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:44.141317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:44.149179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1cd72c1e-35d8-48d0-93e8-6b7dad056cd0 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.159660 Aug 23 22:34:44.149841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 212/439] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:43 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:44.991919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:44.992653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:44.998703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:44.999176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:44.999603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:45.000279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:45.000724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:45.001200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:45.139253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:45.147714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-894cb552-f391-4148-93cc-0f67cfd4d14e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.159115 Aug 23 22:34:45.157078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 228/440] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:44 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:45.170145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:45.170781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:45.177523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:45.178061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:45.178663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:45.179556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:45.180014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:45.180438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:45.316821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:45.326225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-54de31e8-0549-4fa7-97d7-823774884083 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.160241 Aug 23 22:34:45.326939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 213/441] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:45 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:46.169173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:46.169797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:46.175948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:46.176436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:46.176881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:46.177606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:46.178068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:46.179329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:46.311409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:46.319551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c938cfe-65a1-474e-ab5e-e21893e3df99 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.154110 Aug 23 22:34:46.320299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 229/442] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:46 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:46.348424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:46.349071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:46.359125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:46.359615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:46.360044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:46.360739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:46.361227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:46.361644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:46.493542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:46.501435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a3825cd5-82c4-4268-a8a0-bbd2dbe5ef38 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.157548 Aug 23 22:34:46.501999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 214/443] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:46 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:47.347991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:47.349635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:47.355323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:47.355893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:47.356371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:47.357182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:47.357643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:47.358074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:47.500079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:47.508091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c1e3a14e-eaad-4b64-af66-f24b3d16fc5d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.164330 Aug 23 22:34:47.508663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 230/444] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:47 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:47.522006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:47.522682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:47.529146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:47.529645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:47.530083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:47.530779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:47.531240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:47.531664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:47.676673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:47.684732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-63072c73-7f60-4a9a-ae35-79ecd63a8584 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.166525 Aug 23 22:34:47.685335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 215/445] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:47 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:48.530058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:48.530617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:48.536641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:48.541825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:48.541825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:48.541825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:48.541825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:48.542210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:48.685529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:48.693859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b888d885-5ab1-4bb7-a8bf-0d9486d6dec2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.167800 Aug 23 22:34:48.709268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 231/446] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:48 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:48.709627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:48.709627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:48.717145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:48.717634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:48.718116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:48.719012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:48.719455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:48.719876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:48.863131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:48.871157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ad64ad65-a518-4976-998b-70302667f9c2 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1314 microversion: 2.1 time: 0.168747 Aug 23 22:34:48.871721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 216/447] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:48 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:49.715296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:49.715862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:49.722080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:49.722561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:49.722988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:49.723667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:49.724108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:49.724519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:49.860649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:49.871187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-90dd8791-671e-4629-ae0f-58a929ca20da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.158047 Aug 23 22:34:49.871187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 232/448] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:49 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:49.879526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd", "name": "network-vif-plugged", "status": "completed", "tag": "ea342964-7d30-4741-9e4d-2f9b0e9a2a39"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:49.892330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:49.893051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:49.893929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:49.894565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:49.895224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:49.900138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:49.900646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:49.901133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:49.902099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:49.903018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:49.903451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:49.910010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] Creating event network-vif-plugged:ea342964-7d30-4741-9e4d-2f9b0e9a2a39 for instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd on hv-cinder-84254 Aug 23 22:34:49.917292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-d87b02a4-fa63-4ccc-9361-3a9bad4c6305 req-d646793e-60fd-47fd-a921-1ffdc85974ce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040341 Aug 23 22:34:49.917292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 217/449] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:50.053469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:50.063011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-661f64d2-cb5d-43f1-a705-72c96401a9b5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1497 microversion: 2.1 time: 0.175098 Aug 23 22:34:50.063591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 233/450] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:49 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:50.892595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:50.893478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:50.900184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:50.903947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:50.903947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:50.903947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:50.903947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:50.904238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:51.042552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:51.050279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ae37c2a4-aa27-45c5-b79c-eb793f12fba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.162452 Aug 23 22:34:51.050839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 218/451] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:50 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:51.502526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:51.503032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:51.504999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:51.510494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:51.511113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:51.511564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:51.512251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:51.512770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:51.513223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:51.540939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:34:52.044180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2da9e833-9175-4744-a7d6-5a75896c5ee8 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 204 len: 0 microversion: 2.1 time: 0.545482 Aug 23 22:34:52.044853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 234/452] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:34:51 2022] DELETE /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:34:52.053174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:52.053827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:52.060258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:52.060741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:52.061218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:52.061906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:52.062359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:52.062784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:52.072894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:52.073721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:52.080439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:52.080840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:52.081406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:52.082169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:52.082666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:52.083140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:52.089488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:52.211545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:52.220871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7cb86ce0-849b-42e7-9e79-ef26f313edb9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1503 microversion: 2.1 time: 0.171567 Aug 23 22:34:52.222010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 219/453] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:52 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:52.236859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:52.246349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-facd5d2c-6afc-40f7-85b1-8dfb9f3f9394 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.178260 Aug 23 22:34:52.246998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 235/454] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:52 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:53.243622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:53.244231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:53.251539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:53.252209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:53.252759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:53.253607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:53.254217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:53.254758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:53.269746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:53.270962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:53.280242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:53.281040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:53.281541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:53.282667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:53.283282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:53.283977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:53.420333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:53.428297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca71e280-29d1-4336-9ffb-f3a741a3da96 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1503 microversion: 2.1 time: 0.188909 Aug 23 22:34:53.429536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 220/455] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:53 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:53.441142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:53.442649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78677030-3672-4f2c-9577-6a0e1907aa00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1318 microversion: 2.1 time: 0.176971 Aug 23 22:34:53.443246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 236/456] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:53 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:54.449710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:54.450328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:54.456745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:54.457289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:54.457723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:54.458418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:54.458873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:54.459301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:54.464444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:54.465039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:54.471362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:54.471959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:54.472367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:54.473074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:54.473519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:54.473933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:54.614256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:54.624360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-11289a91-376b-442d-b359-2888634d2dd9 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1503 microversion: 2.1 time: 0.178807 Aug 23 22:34:54.625182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 221/457] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:54 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:54.701631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:54.711306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8b7694aa-e3fb-4c0c-b2bb-e3c852eeec57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1507 microversion: 2.1 time: 0.251419 Aug 23 22:34:54.712029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 237/458] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:54 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:55.276983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda9ce75-705d-444e-b1c3-4dd751cadd50", "name": "network-vif-deleted", "tag": "b9706a3b-2f07-4b24-a2ef-d59825d4789a"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:55.286941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:55.287426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:55.287855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:55.300497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] Creating event network-vif-deleted:b9706a3b-2f07-4b24-a2ef-d59825d4789a for instance fda9ce75-705d-444e-b1c3-4dd751cadd50 on hv-cinder-84254 Aug 23 22:34:55.306192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-c7a9d571-cd47-44d0-9261-dff058241b94 req-1c6e57cc-b133-4708-a45f-d0b7f79480dd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Aug 23 22:34:55.306821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 222/459] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:55.649615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:55.650450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:55.658104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:55.658928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:55.662729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:55.662729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:55.662729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:55.662729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:55.707737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:55.708233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:55.708717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:55.709240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lazy-loading 'fault' on Instance uuid fda9ce75-705d-444e-b1c3-4dd751cadd50 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:34:55.769134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:55.789884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c1bff591-b59f-4016-8cbe-e9830a6441eb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1304 microversion: 2.1 time: 0.145261 Aug 23 22:34:55.790606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 238/460] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:55 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:56.811975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:56.812875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:56.818233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=56 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:56.822741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:56.823309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:56.823832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:56.824636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:56.825117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:56.825544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:56.863757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:56.864325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:56.864777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:56.865430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lazy-loading 'fault' on Instance uuid fda9ce75-705d-444e-b1c3-4dd751cadd50 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:34:56.936700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:56.946103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bf46ca82-de68-459d-816f-2a80ecdd8407 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 200 len: 1304 microversion: 2.1 time: 0.138599 Aug 23 22:34:56.947278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 223/461] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:56 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:57.967497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:57.968474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: fda9ce75-705d-444e-b1c3-4dd751cadd50] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:57.974779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:57.975267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:57.975707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:57.976416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:57.976859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:57.977824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:57.992334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] HTTP exception thrown: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Request method failure captured: Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 HTTP/1.1 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVXjQDAS-r2Ov4Oa3grmhx9QDRw6kObzVZL_tj_ffdBCZ8mKxOFnLXMgQyY70e5hlU4Co_pdSxPgiUIEhrXSZr4Jz09gkNiGqzhzKwXcjl1TQqRK2x-8BRrPI9e76MsLpfy7HLlX6QIkWeEKKrT43ViML5DTF5sgrJjksKT7Jl2m31I Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 0fb8b4774d54411099bec473966aced5 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesActionsTest-214524717 Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:34:57.994712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0fb8b4774d54411099bec473966aced5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0fb8b4774d54411099bec473966aced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0fb8b4774d54411099bec473966aced5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0fb8b4774d54411099bec473966aced5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesActionsTest-214524717 Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 0fb8b4774d54411099bec473966aced5 Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesActionsTest-214524717 Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesActionsTest-214524717-project Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: e037a0abf77f45d7befabbf8d05fcd53 Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesActionsTest-214524717-project Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. Aug 23 22:34:57.996316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'fda9ce75-705d-444e-b1c3-4dd751cadd50'} Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:34:58.001270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. Aug 23 22:34:58.002586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:34:58.003811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Returning 404 to user: Instance fda9ce75-705d-444e-b1c3-4dd751cadd50 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:34:58.003811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f20677d6-40f9-4ccf-9958-e536505afbbb tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50" status: 404 len: 111 microversion: 2.1 time: 0.032577 Aug 23 22:34:58.003811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 239/462] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:57 2022] GET /compute/v2.1/servers/fda9ce75-705d-444e-b1c3-4dd751cadd50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:34:58.111284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1064667504", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "networks": [{"uuid": "6bb59ad9-6c99-4ab5-b6e7-8ef6d02d4d80"}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:58.175845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] validate_networks() for [('6bb59ad9-6c99-4ab5-b6e7-8ef6d02d4d80', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:34:58.585462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:34:58.585892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:34:58.586423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:34:58.586844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:34:58.587266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:34:58.597477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:58.597968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:58.598408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:58.599145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:58.599604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:58.600039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:58.621619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Getting quotas for project 0fb8b4774d54411099bec473966aced5. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:34:58.626439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Getting quotas for user e037a0abf77f45d7befabbf8d05fcd53 and project 0fb8b4774d54411099bec473966aced5. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:34:58.639247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:34:58.641624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:34:58.901522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e8297915-2dc6-4e70-a192-ed1822acf28a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793710 Aug 23 22:34:58.906806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 224/463] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:34:58.913276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ca1950f2-b0a3-44f6-bb65-fe3e00045d90 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:58.914039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ca1950f2-b0a3-44f6-bb65-fe3e00045d90 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:58.991017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca1950f2-b0a3-44f6-bb65-fe3e00045d90 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:58.998798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ca1950f2-b0a3-44f6-bb65-fe3e00045d90 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1214 microversion: 2.1 time: 0.089327 Aug 23 22:34:59.012849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 240/464] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:58 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:59.016763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:59.028840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:59.029381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:59.029951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:59.110876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Going to try to stop instance {{(pid=121885) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 22:34:59.564876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f025a835-f526-4a18-b8dd-12239d90778d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action" status: 202 len: 0 microversion: 2.1 time: 0.552004 Aug 23 22:34:59.569160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 225/465] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:34:59 2022] POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:34:59.574733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:59.575350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:59.587475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:59.587975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:59.588414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:59.589168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:59.589624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:59.590044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:59.748841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:59.757929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-515a6022-d3f7-491c-897a-e17739dc5acf tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.187462 Aug 23 22:34:59.759702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 241/466] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:59 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:00.022134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-40646c73-c47e-48eb-86ed-1d393f89f6b7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:00.022889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-40646c73-c47e-48eb-86ed-1d393f89f6b7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:00.122735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-40646c73-c47e-48eb-86ed-1d393f89f6b7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:00.130026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-40646c73-c47e-48eb-86ed-1d393f89f6b7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1214 microversion: 2.1 time: 0.112412 Aug 23 22:35:00.130680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 226/467] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:00 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:00.780517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:00.781168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:00.797292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:00.797292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:00.797292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:00.797292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:00.797664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:00.797664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:00.934067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:00.944177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bedc534f-34d3-499d-b635-81ba45049b12 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.167563 Aug 23 22:35:00.944790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 242/468] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:00 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:01.154166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:01.161234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:01.162769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:01.163534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:01.164132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:01.166132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:01.166588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:01.167012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:01.232534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:01.240157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b66cff2c-8eb2-4f03-a9ff-f56d6ce7ca42 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1266 microversion: 2.1 time: 0.090895 Aug 23 22:35:01.240807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 227/469] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:01 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:01.966070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:01.966783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:01.973746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:01.980301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:01.980301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:01.980301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:01.980301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:01.980758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:02.128031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:02.136515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-88c332c8-7898-4996-9dc7-017a3b0d62b2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.174623 Aug 23 22:35:02.137099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 243/470] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:01 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:02.263944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:02.263944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:02.270846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:02.271411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:02.272188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:02.272725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:02.273284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:02.274413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:02.343809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:02.351713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2babe00c-b89b-4b43-bdc7-426257e9e045 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1274 microversion: 2.1 time: 0.092720 Aug 23 22:35:02.361214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 228/471] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:02 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:03.158897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:03.159684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:03.168142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:03.168631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:03.169106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:03.169799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:03.170277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:03.170701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:03.326307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:03.336773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-df0886f5-de5a-4a35-82b9-d18285d61d89 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.181357 Aug 23 22:35:03.337646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 244/472] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:03 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:03.377220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:03.378593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:03.386589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:03.387369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:03.388070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:03.388520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:03.389044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:03.389740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:03.596139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:03.605651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b5bb7795-9f9f-48f3-8691-2bc5cae2f843 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.234529 Aug 23 22:35:03.606233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 229/473] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:03 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:04.030681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3955ab41-cffc-47af-b0fd-e1a554a2ac94", "tag": "4e100186-8d81-4563-937d-70c9e86f0275"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:04.042206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.042670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.043313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.056550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] Creating event network-changed:4e100186-8d81-4563-937d-70c9e86f0275 for instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 on hv-cinder-84254 Aug 23 22:35:04.061915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-8bf3378a-986c-4724-9192-808f5d0dd230 req-5932fd0f-31b4-4b21-a31f-4e893f592f35 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034750 Aug 23 22:35:04.062510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 245/474] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:35:04.360546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:04.362448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:04.367523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.368020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.368648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.369389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.369850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.370273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.386689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:04.546650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:04.557078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-48efe55e-3b27-4b22-a5c2-5d7f8616c7e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.200581 Aug 23 22:35:04.557693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 230/475] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:04 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:04.630509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:04.631277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:04.638629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.639101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.639546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.640249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.640689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.641330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.802895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:04.811066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f2ec35ee-390e-4e2a-b626-c1ae9e05a614 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.185118 Aug 23 22:35:04.811797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 246/476] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:04 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:05.578695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:05.579459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:05.586947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.587436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.587959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.588652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.589155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.589583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.733835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:05.742498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2122514d-657f-4e3f-833a-dcf76c53afb8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.167599 Aug 23 22:35:05.743461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 231/477] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:05 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:05.832325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:05.832936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:05.840078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.841036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.841569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.842949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.843540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.844340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.999092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:06.007525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-327b4954-2459-4913-bb1b-d83b16655d9b tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.179163 Aug 23 22:35:06.008980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 247/478] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:05 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:06.764943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:06.765569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:06.772330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:06.774084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:06.774084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:06.774936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:06.775440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:06.775871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:06.912699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:06.922223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cee939fc-9b6e-47c1-a482-4bafc29abf3e tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.161232 Aug 23 22:35:06.922788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 232/479] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:06 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:07.028364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:07.028950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:07.035004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:07.035484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:07.035919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:07.036604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:07.037080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:07.037503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:07.171625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:07.179340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a13aa3f6-9c6b-4293-b6cd-18c8a6375db1 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.154787 Aug 23 22:35:07.180881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 248/480] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:07 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:07.946917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:07.947721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:07.954369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:07.954861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:07.955301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:07.956013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:07.956470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:07.957342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:08.092162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:08.100616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a7533b17-d7c4-46db-b8bc-8eaf9313e8cb tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.158832 Aug 23 22:35:08.101964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 233/481] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:07 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:08.202948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:08.203468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:08.209796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:08.210282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:08.210723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:08.211414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:08.211874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:08.212298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:08.349786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:08.358170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ff65adc0-5eec-418b-bdb4-12eb29fa6cc7 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.160275 Aug 23 22:35:08.358713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 249/482] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:08 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:09.124297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:09.124988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:09.126753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:09.132237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.133509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.133509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.134278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.134898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.135371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.271800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:09.292151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f16bf054-2f55-4a6c-9541-af0ffd3fe7e7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.161683 Aug 23 22:35:09.292151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 234/483] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:09 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:09.436082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:09.436667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:09.439109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:09.449161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.449161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.449161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.449161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.449643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.449643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.607387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:09.615344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4b777f0-8132-4d99-a2fd-d62c94dbb1d3 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.183223 Aug 23 22:35:09.616045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 250/484] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:09 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:10.302911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:10.303528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:10.305885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=8 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:10.311573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.312070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.312509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.313253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.313709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.314131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.455276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:10.465183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa8a5504-10ae-4fec-96a6-8f246fa01499 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.166249 Aug 23 22:35:10.465789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 235/485] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:10 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:10.636440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:10.637305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:10.643512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.644028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.645080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.645788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.646305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.646797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.814031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:10.821783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e0ee4c4-5c6f-4ec8-8bb9-77a9d8d4ab17 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.189899 Aug 23 22:35:10.822348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 251/486] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:10 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:11.488336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:11.489475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:11.496857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.497366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.497874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:11.498562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.499008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.499429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:11.631608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:11.640097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c5b836bb-3933-4231-8097-73a026ca44f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.156008 Aug 23 22:35:11.640669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 236/487] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:11 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:11.843032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:11.843661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:11.849744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.850229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.850669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:11.851362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.851811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.852457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:11.987050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:11.994977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3a008564-26c1-4cb2-a9c9-7f824e6f9691 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.156023 Aug 23 22:35:11.996216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 252/488] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:11 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:12.661693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:12.662336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:12.669314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:12.669799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:12.670228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:12.670976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:12.671440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:12.671857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:12.808548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:12.816804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-74927ad0-fbfd-4dd7-b5ee-378f9b39885a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.159079 Aug 23 22:35:12.817398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 237/489] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:12 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:13.016075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:13.016997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:13.022576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.023063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.023495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.024597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.025275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.025701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.169164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:13.171401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:13.177553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5dd5acb1-dbaf-4a47-a111-f3f267b92273 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.165593 Aug 23 22:35:13.178124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 253/490] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:13 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:13.839443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:13.840220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:13.847338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.847869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.848375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.849321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.849674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.850104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.980988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:13.989352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2c5cc9a5-91e4-46ae-bd3a-82155217e93b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.154447 Aug 23 22:35:13.989925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 238/491] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:13 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:14.199450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:14.200062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:14.206398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:14.206879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:14.207338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:14.208019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:14.208459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:14.208872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:14.344112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:14.353670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-84749722-8bd1-46c2-ba76-7110080a33b4 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.158675 Aug 23 22:35:14.354313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 254/492] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:14 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:15.013343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:15.014112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:15.022689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.023289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.023894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.025567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.026107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.026671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.188639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:15.197945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-93549fbd-5774-4e79-8ad6-82027e54c4f6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.189800 Aug 23 22:35:15.198519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 239/493] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:15 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:15.379213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:15.379849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:15.386321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.386800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.387226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.387906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.388348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.388759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.521935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:15.529676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97ab8d36-abbd-4da1-b7d7-288762585b91 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.154315 Aug 23 22:35:15.533825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 255/494] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:15 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:16.219226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:16.219890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:16.226222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:16.226732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:16.227672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:16.228387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:16.228848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:16.229359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:16.363820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:16.372459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e50c4e73-1711-4b3b-a68e-036c524236a7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.157316 Aug 23 22:35:16.373170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 240/495] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:16 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:16.550433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:16.550981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:16.557831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:16.558056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:16.558491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:16.559195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:16.559647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:16.560067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:16.704974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:16.713603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9a5dbc92-9809-4ff2-9ac7-51ae36384c6a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.167133 Aug 23 22:35:16.714175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 256/496] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:16 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:17.394524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:17.395125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:17.402323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.402841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.403316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.404067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.404526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.404954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.539821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:17.548210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-80031538-fb72-4fb5-a5bc-c4de614de588 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.157941 Aug 23 22:35:17.548675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 241/497] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:17 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:17.683326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3955ab41-cffc-47af-b0fd-e1a554a2ac94", "name": "network-vif-plugged", "status": "completed", "tag": "4e100186-8d81-4563-937d-70c9e86f0275"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:17.693817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.694523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.695144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.707330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] Creating event network-vif-plugged:4e100186-8d81-4563-937d-70c9e86f0275 for instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 on hv-cinder-84254 Aug 23 22:35:17.714747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-d43896e5-86d3-42dc-b67e-7709fad3373d req-0bd37547-a8a5-4d53-9f36-7738a061692c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035204 Aug 23 22:35:17.715433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 257/498] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:35:17.734970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:17.735575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:17.741881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.742374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.743353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.744031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.744488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.744912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.897089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:17.905337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8d3deb94-334a-4e6e-bfa7-b3859489f123 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.174215 Aug 23 22:35:17.905909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 242/499] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:17 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:18.570044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:18.570761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:18.577027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.577534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.577971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:18.578664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.579131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.579543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:18.722063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:18.731201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cbaeb6b5-51e6-4d63-9219-5feb2dd241f5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.165200 Aug 23 22:35:18.731780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 258/500] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:18 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:18.932875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:18.932875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:18.934336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.935034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.935475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:18.936182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.936644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.937192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.082966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:19.093215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b56473a0-8851-4c58-a54c-6ce5740fb82f tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.170461 Aug 23 22:35:19.094019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 243/501] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:18 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:19.752970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:19.753558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:19.759605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.760108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.760744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.761731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.762185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.762610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.892658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:19.901022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-73a4e58c-0caf-4faf-8a8e-8498e14881f3 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.151922 Aug 23 22:35:19.901660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 259/502] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:19 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:20.117207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:20.117768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:20.125244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:20.125745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:20.126183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:20.126971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:20.127427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:20.127853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:20.265845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:20.273819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c6b8b0c0-312e-4877-9feb-5cf091cd3de5 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1314 microversion: 2.1 time: 0.160798 Aug 23 22:35:20.274385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 244/503] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:20 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:20.922835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:20.923431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:20.929453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:20.930059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:20.930363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:20.931055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:20.931503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:20.931923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:21.075420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:21.085038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d1b9074-0dd9-493d-a0e9-2e58203934d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1722 microversion: 2.1 time: 0.166090 Aug 23 22:35:21.085616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 260/504] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:20 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:21.295305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:21.295976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:21.302331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:21.302807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:21.303235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:21.303920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:21.304366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:21.304779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:21.435915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:21.443666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-796376ac-817b-4abb-abe2-a196b1352489 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1497 microversion: 2.1 time: 0.152215 Aug 23 22:35:21.444239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 245/505] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:21 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:22.107958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:22.108627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:22.110693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:22.115754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.116326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.116824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.117626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.118207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.118713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.260209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:22.269716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bfb15d46-d1c7-4b44-9c09-1776fe9acb62 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1699 microversion: 2.1 time: 0.165864 Aug 23 22:35:22.270289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 261/506] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:22 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:22.295905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:22.302369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.303114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.303547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.327590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Going to try to start instance {{(pid=121885) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 22:35:22.341767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:22.678185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6bd43b83-9c85-4d21-9c90-b63f652dcc7f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action" status: 202 len: 0 microversion: 2.1 time: 0.386442 Aug 23 22:35:22.681420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 246/507] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:35:22 2022] POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:35:22.690605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:22.691800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:22.697878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.698353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.698785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.699574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.699917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.700328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.738729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:22.739456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:22.748015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.750069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.750620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.751437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.752271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.752804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.785438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:35:22.847817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:22.856833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5edc176-85ab-4631-8eb4-245cce62de17 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1708 microversion: 2.1 time: 0.171757 Aug 23 22:35:22.857438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 262/508] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:22 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:23.200730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5405edeb-47d8-4030-b20a-6252a7318b98 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 204 len: 0 microversion: 2.1 time: 0.466289 Aug 23 22:35:23.203775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 247/509] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:35:22 2022] DELETE /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:35:23.212362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:23.212963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:23.219601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:23.220080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:23.220503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:23.221296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:23.221744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:23.222177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:23.359583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:23.367974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ee03a8ba-b4cd-4e29-ab94-c90599fd7c0a tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1503 microversion: 2.1 time: 0.159520 Aug 23 22:35:23.368549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 263/510] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:23 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:23.885063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:23.885740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:23.892240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:23.892784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:23.893279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:23.898209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:23.898209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:23.898209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:24.028628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:24.036858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e62c012-451e-4937-a726-64e3bd720456 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1708 microversion: 2.1 time: 0.161299 Aug 23 22:35:24.037452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 248/511] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:23 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:24.389698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:24.390305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:24.396367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:24.396891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:24.397466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:24.398147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:24.398548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:24.398974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:24.536018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:24.544642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78ca128d-e467-45b4-bee2-3004bf364423 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1503 microversion: 2.1 time: 0.158840 Aug 23 22:35:24.545251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 264/512] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:24 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:25.058829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:25.059444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:25.066244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:25.066727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:25.067157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:25.067929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:25.068371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:25.068958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:25.218269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:25.227338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eec0011f-d018-4c8e-9bd0-769af170bfdd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1708 microversion: 2.1 time: 0.173264 Aug 23 22:35:25.227917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 249/513] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:25 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:25.565766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:25.566380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:25.573546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:25.574280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:25.574760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:25.575647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:25.576270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:25.576757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:25.722267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:25.730648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a0970fd4-a4dc-4d8d-8c1d-4a8fad6ac557 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1503 microversion: 2.1 time: 0.169134 Aug 23 22:35:25.731226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 265/514] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:25 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:26.248741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:26.249319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:26.255922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:26.256414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:26.256855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:26.266263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:26.266263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:26.266263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:26.376071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3955ab41-cffc-47af-b0fd-e1a554a2ac94", "name": "network-vif-deleted", "tag": "4e100186-8d81-4563-937d-70c9e86f0275"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:26.387028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:26.387252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:26.387685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:26.400078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] Creating event network-vif-deleted:4e100186-8d81-4563-937d-70c9e86f0275 for instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 on hv-cinder-84254 Aug 23 22:35:26.410406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-b32132ff-45be-488c-9028-bd1c2db17140 req-85e46638-a536-4015-8e17-9b8a4fd2512a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039239 Aug 23 22:35:26.411182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 266/515] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:35:26.444179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:26.453977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-32b56ae2-e312-4bd8-840f-74c81181c971 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1708 microversion: 2.1 time: 0.209191 Aug 23 22:35:26.454606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 250/516] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:26 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1708 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:26.752547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:26.753319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:26.759659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:26.760788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:26.761285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:26.762002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:26.762459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:26.762895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:26.829380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:26.837253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42d233e8-2252-4623-b8c8-d3972aa0ee36 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1461 microversion: 2.1 time: 0.088854 Aug 23 22:35:26.837846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 267/517] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:26 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:27.475905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:27.476545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:27.483426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:27.483930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:27.484468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:27.485159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:27.485538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:27.485945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:27.635212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:27.644620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d6cfabaa-8e7c-45f1-b6b2-44d96b233e06 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1712 microversion: 2.1 time: 0.172503 Aug 23 22:35:27.645293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 251/518] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:27 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:27.862311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:27.863373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:27.870994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:27.871519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:27.871969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:27.873031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:27.873948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:27.874543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:27.910647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:27.911150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:27.911564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:27.912088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lazy-loading 'fault' on Instance uuid 3955ab41-cffc-47af-b0fd-e1a554a2ac94 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:35:27.954879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e037a0abf77f45d7befabbf8d05fcd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8b4774d54411099bec473966aced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:27.964131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cdb57a61-ba5c-46b7-a5d7-a7f73297c65d tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 200 len: 1304 microversion: 2.1 time: 0.105978 Aug 23 22:35:27.964998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 268/519] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:27 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:28.986683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:28.987304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] [instance: 3955ab41-cffc-47af-b0fd-e1a554a2ac94] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:28.989902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:28.994671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:28.995160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:28.995608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:28.996320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:28.996773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:28.997262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:29.011858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] HTTP exception thrown: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Request method failure captured: Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 HTTP/1.1 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVXjQDAS-r2Ov4Oa3grmhx9QDRw6kObzVZL_tj_ffdBCZ8mKxOFnLXMgQyY70e5hlU4Co_pdSxPgiUIEhrXSZr4Jz09gkNiGqzhzKwXcjl1TQqRK2x-8BRrPI9e76MsLpfy7HLlX6QIkWeEKKrT43ViML5DTF5sgrJjksKT7Jl2m31I Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 0fb8b4774d54411099bec473966aced5 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-VolumesActionsTest-214524717 Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:35:29.013544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0fb8b4774d54411099bec473966aced5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0fb8b4774d54411099bec473966aced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0fb8b4774d54411099bec473966aced5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0fb8b4774d54411099bec473966aced5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-VolumesActionsTest-214524717 Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 0fb8b4774d54411099bec473966aced5 Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-VolumesActionsTest-214524717 Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-VolumesActionsTest-214524717-project Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: e037a0abf77f45d7befabbf8d05fcd53 Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-VolumesActionsTest-214524717-project Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. Aug 23 22:35:29.015077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '3955ab41-cffc-47af-b0fd-e1a554a2ac94'} Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:35:29.016034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. Aug 23 22:35:29.017608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:35:29.019220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] Returning 404 to user: Instance 3955ab41-cffc-47af-b0fd-e1a554a2ac94 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:35:29.019220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-74b78155-d2d9-4999-a97b-2ea72ce94c68 tempest-VolumesActionsTest-214524717 tempest-VolumesActionsTest-214524717-project] 10.222.0.73 "GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94" status: 404 len: 111 microversion: 2.1 time: 0.032523 Aug 23 22:35:29.019220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 252/520] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:28 2022] GET /compute/v2.1/servers/3955ab41-cffc-47af-b0fd-e1a554a2ac94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:35:29.723975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4baeafb6-2159-4a59-b736-22757b4132ac", "device": "/dev/sdb"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:29.726833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:29.733906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:29.734400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:29.734847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:29.735549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:29.736006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:29.736432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:30.923741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5ebbe95f-7496-4301-b4b0-5734ad0304ef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "POST /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203623 Aug 23 22:35:30.924469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 269/521] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:35:29 2022] POST /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd/os-volume_attachments => generated 194 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:36:14.116558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:14.117311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:14.119503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:14.125273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.125770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.126211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.126927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.127384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.127811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.523876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lazy-loading 'services' on Instance uuid 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:36:14.879232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a83d89a6-86ff-46ff-93f4-2848ce43a88a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd/os-volume_attachments/4baeafb6-2159-4a59-b736-22757b4132ac" status: 202 len: 0 microversion: 2.1 time: 0.766654 Aug 23 22:36:14.879734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 253/522] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:36:14 2022] DELETE /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd/os-volume_attachments/4baeafb6-2159-4a59-b736-22757b4132ac => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:36:17.081943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=19 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:17.082792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:17.087085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:17.087680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:17.094373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:17.096807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:17.096807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:17.096807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:17.096807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:17.097375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:17.126178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:36:17.497351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f05b3c2-837e-4be1-a551-26ef36c3e544 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 204 len: 0 microversion: 2.1 time: 0.416612 Aug 23 22:36:17.498441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 270/523] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:36:17 2022] DELETE /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:36:17.513301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:17.513301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:17.516460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:17.517076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:17.517518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:17.518285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:17.518986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:17.519410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:17.731267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:17.739946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb3f083a-2284-48d3-8bc8-9b810a92f75e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1513 microversion: 2.1 time: 0.236056 Aug 23 22:36:17.740549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 254/524] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:17 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:18.765604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:18.766488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:18.773595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:18.774165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:18.774525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:18.775236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:18.775769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:18.776858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:19.080148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:19.091198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4276d447-0bfa-4af5-a5f8-d98d2dea45e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1513 microversion: 2.1 time: 0.331716 Aug 23 22:36:19.091808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 271/525] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:18 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:20.112546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:20.117603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:20.125337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:20.125831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:20.126462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:20.127638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:20.128257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:20.128841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:20.442638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:20.453987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-30050b70-d106-4551-8fa4-bdb23eca4da2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1513 microversion: 2.1 time: 0.343898 Aug 23 22:36:20.464815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 255/526] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:20 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:20.656939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd", "name": "network-vif-deleted", "tag": "ea342964-7d30-4741-9e4d-2f9b0e9a2a39"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:20.674254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:20.674254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:20.674254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:20.698215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] Creating event network-vif-deleted:ea342964-7d30-4741-9e4d-2f9b0e9a2a39 for instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd on hv-cinder-84254 Aug 23 22:36:20.704573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-c95e551b-38a5-4033-8090-15c32e77d3b0 req-9e3b1b76-85ee-4cd2-9563-57d11703331d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053523 Aug 23 22:36:20.705325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 272/527] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:36:21.475876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:21.476496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:21.483731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:21.489613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:21.490065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:21.490808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:21.491265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:21.491691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:21.566573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:21.566573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:21.566573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:21.566573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lazy-loading 'fault' on Instance uuid 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:36:21.661068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:21.672644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-65871452-b8d9-401e-8a9e-7712ac3d8a19 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 200 len: 1308 microversion: 2.1 time: 0.200233 Aug 23 22:36:21.673459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 256/528] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:21 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:22.710871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:22.711571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:22.719899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:22.720392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:22.720825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:22.721574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:22.722105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:22.722582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:22.743140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] HTTP exception thrown: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Request method failure captured: Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd HTTP/1.1 Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVXnl1k5lF6iI31qwFjJqFPtbcBAmX2WctcTqGCj82K_M9paDV2zJ26_WfkXAltaPCnrVPtk9knm1aHSUbHxoBCyTWhAb4jlXNV9IBB3zlAtrpdhH9AIQYEyzZeeGQTkxB006vPgT3gcGCx5TdG45SfXwjW2PV89YsnWxcU1xDfAIWo Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 182b0a6a36fb4c14816d9f94b270686c Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1486152270 Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:36:22.744978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/182b0a6a36fb4c14816d9f94b270686c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/182b0a6a36fb4c14816d9f94b270686c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/182b0a6a36fb4c14816d9f94b270686c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_182b0a6a36fb4c14816d9f94b270686c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-VolumesSnapshotTestJSON-1486152270 Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 182b0a6a36fb4c14816d9f94b270686c Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1486152270 Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-VolumesSnapshotTestJSON-1486152270-project Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: adc12894a7c94ae1b06340353fd99654 Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-VolumesSnapshotTestJSON-1486152270-project Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. Aug 23 22:36:22.746799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd'} Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:36:22.747692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. Aug 23 22:36:22.749370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:36:22.750762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Returning 404 to user: Instance 0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:36:22.751315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-22ee7ddc-5502-44ff-9636-0c16e165a89e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd" status: 404 len: 111 microversion: 2.1 time: 0.044838 Aug 23 22:36:22.752427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 273/529] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:22 2022] GET /compute/v2.1/servers/0cebf11b-3e4f-4b05-aac6-7b57eeb9d1bd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:36:35.971905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-744827887", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "networks": [{"uuid": "2e17aefa-e764-443a-85d5-ebcc09185e13"}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:35.985585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=11 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:35.986510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:36.039272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] validate_networks() for [('2e17aefa-e764-443a-85d5-ebcc09185e13', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:36:36.593362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:36:36.594192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:36:36.602140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:36:36.602140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:36:36.602140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:36:36.609047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:36.609824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:36.610456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:36.611406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:36.612042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:36.612668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:36.635225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Getting quotas for project 182b0a6a36fb4c14816d9f94b270686c. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:36:36.640655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Getting quotas for user adc12894a7c94ae1b06340353fd99654 and project 182b0a6a36fb4c14816d9f94b270686c. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:36:36.655163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:36:36.657583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:36:36.866803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fbbe8d1b-816e-4e1e-b545-bb5dc943a710 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899104 Aug 23 22:36:36.867751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 257/530] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:36:36.892784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9dc0d582-9ee7-4b07-a253-ed91322ef928 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:36.895254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9dc0d582-9ee7-4b07-a253-ed91322ef928 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:36.902790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:36.905570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:36.991568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9dc0d582-9ee7-4b07-a253-ed91322ef928 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:37.002818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9dc0d582-9ee7-4b07-a253-ed91322ef928 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1218 microversion: 2.1 time: 0.126436 Aug 23 22:36:37.005644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 274/531] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:38.024551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aaeb787f-9a6f-4273-9d84-23f7f6045ce5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:38.025852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aaeb787f-9a6f-4273-9d84-23f7f6045ce5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:38.087451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aaeb787f-9a6f-4273-9d84-23f7f6045ce5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:38.096664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aaeb787f-9a6f-4273-9d84-23f7f6045ce5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1218 microversion: 2.1 time: 0.076741 Aug 23 22:36:38.097224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 258/532] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:38 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:39.120058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:39.120758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:39.131491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:39.131972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:39.132404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:39.133149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:39.133600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:39.134018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:39.211011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:39.219887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-57e8f902-37ae-4603-a174-8ee963bf1274 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1214 microversion: 2.1 time: 0.105805 Aug 23 22:36:39.220468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 275/533] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:40.244322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:40.247199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:40.260551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:40.267008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:40.267754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:40.268707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:40.269380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:40.270053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:40.394535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:40.423420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-61913857-8608-496f-b985-50020e880160 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1278 microversion: 2.1 time: 0.183879 Aug 23 22:36:40.429044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 259/534] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:40 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:41.457828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:41.459854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:41.469964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:41.470425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:41.471103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:41.477254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:41.477254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:41.477254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:41.647523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:41.660219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4704534-5f3b-403e-a521-a5c97b054923 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.206862 Aug 23 22:36:41.660831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 276/535] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:42.696102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:42.696844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:42.703762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:42.704275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:42.704747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:42.705502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:42.706006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:42.706467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:42.920770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:42.935272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ea31767-ba12-49c5-92cf-c7d5e7cf3b52 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.243052 Aug 23 22:36:42.936046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 260/536] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:43.003249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6f94ec-9724-4f7a-82e3-68d1713bb26c", "tag": "48cfdc51-223a-410b-b73a-cece1286e117"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:43.014574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:43.015056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:43.015493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:43.029800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] Creating event network-changed:48cfdc51-223a-410b-b73a-cece1286e117 for instance ff6f94ec-9724-4f7a-82e3-68d1713bb26c on hv-cinder-84254 Aug 23 22:36:43.035288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-343c3571-b5cc-4fe8-a0a6-8cda7c88acdd req-1afdf7d0-df01-44b5-aace-4697e948f9c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217973 Aug 23 22:36:43.035961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 277/537] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:36:43.957952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:43.958665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:43.966307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:43.966794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:43.967223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:43.967930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:43.968378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:43.968792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:44.138390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:44.144976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4f149921-0e41-4a24-b747-1ca5a962d64d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.190793 Aug 23 22:36:44.145626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 261/538] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:44.577344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7fb5a91-58be-49c6-8d46-d0bb2bb06450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'create', calling method: .version_select at 0x7f5ed10c6b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1934368991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItj8zoHlIs1r05ztZ6ZSpmosIWDwEikxz43pQKe17ZwNY4kvG9NqqKP7AGZvIYLycUlw4VqGdBY5I5BbDLHr4rhf+oo4HOkVQkwWyVJC2mldZLalqCZsyIuSCkjcJ/Ceg=="}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:44.595060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-d7fb5a91-58be-49c6-8d46-d0bb2bb06450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Getting quotas for project 754172385f004ede86566e52cddf1d47. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:36:44.599456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-d7fb5a91-58be-49c6-8d46-d0bb2bb06450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Getting quotas for user 692cc40ea1fe47a9904f1370a8d9ba2a and project 754172385f004ede86566e52cddf1d47. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:36:44.714290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7fb5a91-58be-49c6-8d46-d0bb2bb06450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.141489 Aug 23 22:36:44.715046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 278/539] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 22:36:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:36:44.833132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-861096961", "imageRef": "900ea1c5-10ab-45ba-9328-ee7eae49ed61", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1934368991", "networks": [{"uuid": "7839de15-d4e7-471d-9d33-5f258a182ff7"}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:44.894604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] validate_networks() for [('7839de15-d4e7-471d-9d33-5f258a182ff7', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:36:45.167677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:45.168460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:45.175873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:45.176363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:45.176803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:45.177543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:45.177995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:45.178423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:45.324398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:45.332816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:36:45.333442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:36:45.333964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:36:45.334376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:36:45.334785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:36:45.335625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-47bf1d45-8ced-42e2-adb6-7903de3e22d8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.172405 Aug 23 22:36:45.336606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 279/540] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:45 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:45.345533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:45.346014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:45.346622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:45.347515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:45.347972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:45.348395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:45.366150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Getting quotas for project 754172385f004ede86566e52cddf1d47. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:36:45.370342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Getting quotas for user 692cc40ea1fe47a9904f1370a8d9ba2a and project 754172385f004ede86566e52cddf1d47. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:36:45.382158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:36:45.384253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='900ea1c5-10ab-45ba-9328-ee7eae49ed61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:36:45.544108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cc18a469-d08b-45d6-8863-40565b61cf2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715057 Aug 23 22:36:45.544769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 262/541] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:36:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:36:45.556329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a35e7fca-af87-4be3-bb2f-27351405f3cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:45.557076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a35e7fca-af87-4be3-bb2f-27351405f3cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:45.620824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a35e7fca-af87-4be3-bb2f-27351405f3cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:45.628641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a35e7fca-af87-4be3-bb2f-27351405f3cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1258 microversion: 2.1 time: 0.076419 Aug 23 22:36:45.629265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 280/542] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:46.359914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:46.360464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:46.368810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:46.369349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:46.370365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:46.371437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:46.371941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:46.372477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:46.652479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93a4093a-4642-4e09-9820-92ab82120b57 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:46.653348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93a4093a-4642-4e09-9820-92ab82120b57 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:46.719582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-93a4093a-4642-4e09-9820-92ab82120b57 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:46.731911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93a4093a-4642-4e09-9820-92ab82120b57 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1258 microversion: 2.1 time: 0.085553 Aug 23 22:36:46.732978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 281/543] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:46.791168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:46.800209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d71bef68-903f-4a66-b697-35d783c84d7f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.444699 Aug 23 22:36:46.802509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 263/544] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:47.765372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:47.766134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:47.783588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:47.783588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:47.783588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:47.783588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:47.784068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:47.784068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:47.829303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:47.829968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:47.837263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:47.838291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:47.838750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:47.839696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:47.840134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:47.840621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:47.852861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:47.861719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f63c69e5-9871-4987-b818-914aaf666bf3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1254 microversion: 2.1 time: 0.100241 Aug 23 22:36:47.862323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 282/545] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1254 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:47.994051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:48.002707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-890eebd5-aa38-445f-88fd-98fe22c96c66 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.177762 Aug 23 22:36:48.003272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 264/546] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:48.884142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:48.884704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:48.892104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:48.892621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:48.893066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:48.893778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:48.894229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:48.894650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:48.959986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:48.969231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe3e440f-9c01-411c-8efe-0d12a4c982c5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1310 microversion: 2.1 time: 0.088889 Aug 23 22:36:48.969816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 283/547] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:49.024289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:49.024902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:49.031787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:49.032278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:49.039592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:49.039592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:49.039592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:49.039592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:49.255858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:49.265524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e930f0c-a624-434e-8330-755b9ae15ff4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.245085 Aug 23 22:36:49.266382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 265/548] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:49.879873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10ca7eed-de9c-44d5-9c99-7b1df6b28a9c"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:49.882938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:49.890479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:49.891199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:49.891589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:49.892311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:49.892835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:49.893300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:49.997066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:49.997895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:50.004867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:50.005403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:50.005988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:50.007359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:50.007524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:50.007920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:50.313521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:50.332635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-69a0795f-9094-4ead-a6fd-c674d45688be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.343986 Aug 23 22:36:50.335074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 266/549] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:50.345065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:50.346731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:50.381660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:50.382796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:50.383829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:50.385696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:50.386650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:50.388644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:50.701043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:50.710182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8871195a-5c75-4985-8f0a-b2dee02746cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.373342 Aug 23 22:36:50.710962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 267/550] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:50.852986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f94ec-9724-4f7a-82e3-68d1713bb26c", "name": "network-vif-plugged", "status": "completed", "tag": "48cfdc51-223a-410b-b73a-cece1286e117"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:50.874821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:50.875897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:50.876752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:50.909753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] Creating event network-vif-plugged:48cfdc51-223a-410b-b73a-cece1286e117 for instance ff6f94ec-9724-4f7a-82e3-68d1713bb26c on hv-cinder-84254 Aug 23 22:36:50.927374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-569aae6b-d98e-4d5d-b5b8-3cbe25308e7f req-482e1d77-da38-48e8-9379-bbddf907f2c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214358 Aug 23 22:36:50.929119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 268/551] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:36:51.281532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-67ce7330-9720-45eb-aaa3-c0bf97914b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.546835 Aug 23 22:36:51.282624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 284/552] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:36:49 2022] POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 194 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:36:51.375883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:51.376645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:51.383933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:51.385063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:51.386390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:51.387259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:51.387771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:51.388203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:51.556147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:51.564788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fa1f9444-4549-413a-9f1f-0b148146a958 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.193938 Aug 23 22:36:51.565474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 269/553] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:51.734025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:51.734739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:51.743769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:51.744435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:51.745347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:51.746845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:51.747508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:51.748170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:51.911563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:51.919821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4f8f2ad-737a-4a43-9ad3-ead79d600bd5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.191141 Aug 23 22:36:51.920398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 285/554] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:51 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:52.588901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:52.589853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:52.597435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:52.597943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:52.598380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:52.599076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:52.599624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:52.600048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:52.741715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:52.750812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7e3a9cd0-ddc4-4abe-b4e6-fc0c189fdb42 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.166638 Aug 23 22:36:52.751392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 270/555] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:52.941399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:52.941941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:52.948462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:52.948998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:52.949472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:52.950276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:52.950722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:52.951142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:53.091913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:53.100090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4accea25-ef76-472b-bab7-eeb2a535f65d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.162708 Aug 23 22:36:53.100672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 286/556] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:53.490630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:53.491124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:53.498213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:53.498651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:53.499133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:53.499855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:53.500357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:53.500720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:53.527366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7c33e9f4-f6d6-4549-b6e5-3e34305357c0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/ips" status: 200 len: 152 microversion: 2.20 time: 0.040601 Aug 23 22:36:53.527948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 271/557] 10.222.0.73 () {60 vars in 1289 bytes} [Tue Aug 23 22:36:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:36:53.771859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:53.772727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:53.779770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:53.788967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:53.788967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:53.788967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:53.788967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:53.789460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:53.937567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:53.945258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b2ca5a74-ea79-47bc-960e-e7dfa410db2a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.177178 Aug 23 22:36:53.957323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 287/558] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:54.123636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:54.125347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:54.133848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:54.134424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:54.134981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:54.135799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:54.136331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:54.136849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:54.303237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:54.312978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e4ac1a0-9b27-491f-98fc-babd2e7434f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.195019 Aug 23 22:36:54.313693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 272/559] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:54.973416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:54.975372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:54.987047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:54.987903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:54.989056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:54.990586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:54.991520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:54.992375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:55.171394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:55.182717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-212f60af-7cb3-4e47-9adf-88a24b04dedd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.216634 Aug 23 22:36:55.183340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 288/560] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:55.334427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:55.334979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:55.342432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:55.342914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:55.343351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:55.345237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:55.345237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:55.345237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:55.360763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:55.377079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=14 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:55.491269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:55.500916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1077ffcd-9440-4969-b884-0a032b2be6ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.170292 Aug 23 22:36:55.501530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 273/561] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:56.204803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:56.206194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:56.214760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:56.215572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:56.218350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:56.219320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:56.219856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:56.220348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:56.364968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:56.373988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-55093b8d-9fc5-4d90-b098-960bb9126188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.172991 Aug 23 22:36:56.374677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 289/562] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:56.522716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:56.523334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:56.530276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:56.530775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:56.531224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:56.531934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:56.532393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:56.532818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:56.685658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:56.691948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-081cff67-e1f1-42fc-ba7b-7ab30e5c419f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.173015 Aug 23 22:36:56.693319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 274/563] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:57.200718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:57.201283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:57.203284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=10 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:57.208328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.208993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.209266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.209956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.210408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.210879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.237173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lazy-loading 'flavor' on Instance uuid e4822c04-cfe2-4f63-b2db-42c5011791cc {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:36:57.401417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:57.402873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:57.409276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.419690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.419690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.419690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.419690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.420103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.568718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:57.577818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0801f5b3-7519-48fa-9a10-36ed60deb5f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.181022 Aug 23 22:36:57.578775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 275/564] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:57.713973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:57.714840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:57.721340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.721944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.722472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.723199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.723656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.724087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.863215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fd77ed23-3ece-4323-bb26-7820e3d2d9e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/action" status: 202 len: 0 microversion: 2.20 time: 0.666971 Aug 23 22:36:57.865083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 290/565] 10.222.0.73 () {62 vars in 1319 bytes} [Tue Aug 23 22:36:57 2022] POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:36:57.873737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:57.874974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:57.882859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.883844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.883844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.884530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:57.885756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:57.886529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:57.934256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:57.937843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:57.945098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-11595920-b7f8-404b-8a93-16318312fb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.233420 Aug 23 22:36:57.949802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 276/566] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:58.059511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:58.063194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:36:58.063610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:58.063830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:36:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:36:58.069665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:58.071405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:58.072719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-de9d4ba2-3f00-480a-ae4e-658d8463685d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.203511 Aug 23 22:36:58.080552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 291/567] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:36:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:36:58.600294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:58.602019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:58.611066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:58.611559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:58.612156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:58.612914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:58.613425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:58.613853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:58.758342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:58.767167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-464b135c-d49e-4e4d-a582-2610b01ce19f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.171810 Aug 23 22:36:58.767732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 277/568] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:58.976082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:58.976803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:58.984597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:58.985123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:58.985564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:58.986266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:58.986720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:58.987138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:59.150295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:59.150295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:59.150295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:59.150295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:59.150855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:59.150855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:59.150855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:59.150855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:59.151122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:59.151122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-88fcd4e6-abfb-4041-974f-ac907dce7c54 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.168770 Aug 23 22:36:59.151122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 292/569] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:58 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:59.271266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:59.281286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:59.282837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:59.284033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5f8d9bfb-af14-4f31-850a-7e8ada3c5f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.190259 Aug 23 22:36:59.284603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 278/570] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:36:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:36:59.788422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:59.789085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:59.797117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:59.797621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:59.798120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:59.798892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:59.799419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:59.799838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:59.938744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:59.947355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-705eb5ca-2d80-45f7-b474-73e54d411f63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.163011 Aug 23 22:36:59.948181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 293/571] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:00.162963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:00.163714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:00.170038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.170527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.170959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.172013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.172176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.172701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.310778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:00.311357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:00.316608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:00.318206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.318700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.319149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.319853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.320560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.321191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.325255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-913191c6-7a49-4f51-bea6-6980e1833e72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.166063 Aug 23 22:37:00.330885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 279/572] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:00.488767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:00.498535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:00.500062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:00.501291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-87c82cb0-13d3-49b4-86d1-7ba8ff9cde71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.194906 Aug 23 22:37:00.502177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 294/573] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:00.806864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:00.807482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:00.813916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.814408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.815025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.815559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:00.816106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:00.816437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:00.905002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lazy-loading 'services' on Instance uuid bb8f6ad2-07f8-4f77-81d2-70e697b1e275 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:37:00.971311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:00.972320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:00.984544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.035009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.035009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.035009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.035009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.035528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.140069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:01.148080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-505f0d6c-cbc6-421d-be77-79e164df3355 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.182121 Aug 23 22:37:01.148654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 295/574] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:01.196924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2d0fc534-5c76-4f8b-a30e-72bf8834abba tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments/b955777e-7293-4aa9-8f59-b6c3b8adffc7" status: 202 len: 0 microversion: 2.1 time: 0.504153 Aug 23 22:37:01.198323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 280/575] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:37:00 2022] DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments/b955777e-7293-4aa9-8f59-b6c3b8adffc7 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:37:01.347864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:01.348698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:01.356038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.356531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.356978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.357879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.358424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.358926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.511947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:01.520797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d84ded18-476c-4b30-979b-18780e1c5017 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.176789 Aug 23 22:37:01.521985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 296/576] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:01.529299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:01.531120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:01.541729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.542534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.543321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.544303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:01.544999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:01.545767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:01.703321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:01.717061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:01.720063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:01.721667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-42db2678-4c9d-4fac-9178-2644ac3060bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.200861 Aug 23 22:37:01.722316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 281/577] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:02.173471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:02.174091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:02.180482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.180970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.181463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.182302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.182773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.183204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.335394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:02.346087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-221e7061-8019-4df2-a860-afbfd3bba51c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.177176 Aug 23 22:37:02.346674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 297/578] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:02.554247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:02.554814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:02.561974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.562477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.562917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.563625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.564080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.564503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.710600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:02.719408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2097ecb5-4386-4925-b78c-67c2f65e6677 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.168923 Aug 23 22:37:02.720160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 282/579] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:02.746240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:02.748510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:02.754225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.754800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.755241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.755945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:02.756398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:02.756850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:02.902451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:02.912910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:02.914535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:02.915739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b41c9da9-c504-4062-8bb5-0e0b7300a6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.174438 Aug 23 22:37:02.916374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 298/580] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:03.369360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:03.370204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:03.377415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.378126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.378755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:03.379696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.380349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.380974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:03.548032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:03.563386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0985e25d-0342-4419-8581-dc7d861767b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.198930 Aug 23 22:37:03.564437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 283/581] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:03.745427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:03.746056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:03.753201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.753881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.754212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:03.754955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.755988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.755988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:03.904325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:03.913255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0c628c1e-444f-4537-9574-75beda66ba1d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.173447 Aug 23 22:37:03.913848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 299/582] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:03 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:03.939182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:03.939798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:03.946164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.946671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.947166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:03.948465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:03.948954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:03.949380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:04.115883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:04.129912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:04.131869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:04.133351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f7fcfb1-5f47-4350-bb53-1e234083c836 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.198083 Aug 23 22:37:04.134136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 284/583] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:04.586682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:04.587286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:04.594627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:04.595114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:04.595553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:04.596247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:04.596694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:04.597313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:04.728635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:04.736970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-763f9a76-2323-4f39-a59f-2f7ccaab5f60 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.154038 Aug 23 22:37:04.737641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 300/584] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:04.935858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:04.936506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:04.943920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:04.944428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:04.945109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:04.945620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:04.946261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:04.947617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:05.114749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:05.123921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-741731fe-f198-4592-b808-b404c193b825 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.191883 Aug 23 22:37:05.124504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 285/585] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:05.158895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:05.158895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:05.165857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:05.166616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:05.167159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:05.168001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:05.168595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:05.169199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:05.328240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:05.337666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:05.339643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:05.340951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-254a1474-35fd-4ae9-b6b8-985114c5cf3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.187898 Aug 23 22:37:05.341622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 301/586] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:05.758639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:05.759265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:05.765857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:05.766339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:05.766764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:05.767453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:05.767934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:05.768314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:05.905810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:05.913686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2434a4f5-546a-42aa-992e-2963b3168c8b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.158882 Aug 23 22:37:05.914251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 286/587] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:06.145804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:06.146316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:06.153264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.153744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.154171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:06.154866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.155515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.155928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:06.293609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:06.302338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-354f3443-1f62-4188-a2ac-2bb28e8a9716 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.160434 Aug 23 22:37:06.302914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 302/588] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:06 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:06.366046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:06.366656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:06.369271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:06.374342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.374832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.375291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:06.375993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.376441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.376862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:06.515402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:06.524023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:06.526176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:06.527380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-20d9e9e1-ebaf-4ff7-b7f4-4399f1cc5590 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.165318 Aug 23 22:37:06.527957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 287/589] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:06.935444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:06.936945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:06.944565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.945643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.950544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:06.950544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:06.950544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:06.950544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.117506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:07.127469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f5eab67-4c30-438c-a648-0571a1ca8a30 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.196090 Aug 23 22:37:07.143023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 303/590] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:07.326760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:07.327472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:07.333851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:07.334350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:07.334787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.335522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:07.335975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:07.336396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.552219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:07.553744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:07.561304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:07.561795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:07.562261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.562967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:07.563499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:07.563830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.566217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:07.574921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a45b9647-9bbc-4ca9-92a9-ad472122a51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.253914 Aug 23 22:37:07.578184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 288/591] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:07.712087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:07.723452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:07.725082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:07.726492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1f94ad28-33da-4884-a4b6-7484fa5e131d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.178559 Aug 23 22:37:07.727044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 304/592] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:07.792350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:07.805043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:07.805911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:07.807434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:07.822314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] Creating event network-changed:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:37:07.829648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-0a5c968a-b39b-47ab-ab43-09b5c85c7976 req-9d3219bf-be2b-41cc-b393-a21dcc7a6117 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041079 Aug 23 22:37:07.835572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 289/593] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:37:08.149551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:08.151141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:08.158147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.158789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.159232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.159965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.160470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.160846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.438730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:08.447267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1f484256-94ce-4241-a7c2-48251752008d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.301504 Aug 23 22:37:08.447908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 305/594] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:08.597384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:08.598134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:08.605080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.605664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.606103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.606824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.607285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.607710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.753349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:08.754996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:08.775803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.776484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.776922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.777858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:08.778484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:08.779286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:08.795602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:08.815404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e76bc18d-6a85-4432-ad87-d5670e95b75f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.213821 Aug 23 22:37:08.815404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 290/595] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:08.961720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:08.971753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:08.973248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:08.974442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1e18c554-b8d1-4394-a4cf-c495517904ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.227118 Aug 23 22:37:08.975006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 306/596] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:09.469436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:09.470584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:09.480398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:09.481319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:09.481972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:09.482946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:09.483615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:09.487210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:09.733261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:09.744333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-43a6f84f-a1ca-424b-abb8-f568414d96b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.278399 Aug 23 22:37:09.745897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 291/597] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:09.829733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:09.831025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:09.833443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:09.838674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:09.839148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:09.839577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:09.840292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:09.840901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:09.841344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:09.883878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:09.891409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:09.891916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:09.892350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:09.918969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Going to try to stop instance {{(pid=121885) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 22:37:09.950642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:10.003157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.018125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f3f4b401-81c2-43f3-9f31-70166fcd2af7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1318 microversion: 2.1 time: 0.193153 Aug 23 22:37:10.018726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 307/598] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:10.023409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:10.024086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:10.031599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.032115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.032543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.033335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.033941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.035012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.057101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:10.136389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d26aaf2d-e9ee-4d53-9d9f-f549dd2e44c8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action" status: 202 len: 0 microversion: 2.1 time: 0.258667 Aug 23 22:37:10.137019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 292/599] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:37:09 2022] POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:37:10.145774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:10.148465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:10.153774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.154275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.154717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.155431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.155887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.156306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.190729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.197036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.198336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.199539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0dab0b85-311b-4776-b918-a70112dd30ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.179864 Aug 23 22:37:10.200137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 308/600] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:10.312319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.320663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-77ba4bbd-0a4b-4763-8812-5c80134fa773 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.179176 Aug 23 22:37:10.321284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 293/601] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:10 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:10.770050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:10.770591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:10.779354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.779354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.779354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.779785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:10.779990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:10.780418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:10.925359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:10.935038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c8acf4f0-6c40-4f7c-bca1-e30a92da7454 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.169021 Aug 23 22:37:10.935626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 309/602] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:11.039916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:11.040546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:11.047894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.048381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.048818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.049548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.049998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.050419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.201874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:11.212619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-51f948fa-34df-4a9e-8f59-6d0a5ed6e357 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1506 microversion: 2.1 time: 0.176046 Aug 23 22:37:11.213861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 294/603] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:11 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:11.229721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:11.230828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:11.236860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84723997-8b65-451e-90dc-01d11c5d3a44", "device": "/dev/sdb"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:11.239885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:11.241923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.242798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.244126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.245459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.246338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.247118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.247300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.247792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.248226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.248946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.249429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.249851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.445974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:11.456957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:11.458526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:11.459734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5119a784-3d52-45a7-9ac0-f8868727900d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.236218 Aug 23 22:37:11.460306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 310/604] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:11.465748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:11.466352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:11.473898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.474376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.474811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.475610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.476034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.476450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.635777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:11.644679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-61f7ec85-08f1-476e-8374-3597a35d7532 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.183207 Aug 23 22:37:11.645307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 311/605] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:11 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:11.956036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:11.956705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:11.963845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.964338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.964748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:11.965453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:11.965900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:11.966313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:12.095901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:12.104407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ecdd236a-e5cb-40c7-b668-ef5afa96c179 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.152163 Aug 23 22:37:12.104981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 312/606] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:12.483019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:12.483641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:12.489992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:12.490481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:12.490953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:12.491721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:12.492177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:12.492607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:12.637309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:12.645769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:12.647278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:12.648514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-23a5dd1b-2e25-4766-99ee-5489e4e66499 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.169516 Aug 23 22:37:12.649090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 313/607] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:12.671056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:12.672183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:12.683130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:12.683997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:12.684775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:12.686310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:12.687109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:12.687860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:12.827877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:12.835771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4eda665-a452-4159-8491-1c0be8037204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.171996 Aug 23 22:37:12.836344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 314/608] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:12 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:13.125499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:13.126152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:13.132606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.133130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.133577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:13.134346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.134911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.135341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:13.269026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:13.283223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7c029c2c-5710-45ef-999a-146627ecd4e9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.161553 Aug 23 22:37:13.283811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 315/609] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:13.672960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:13.673598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:13.679634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.680128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.680563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:13.681531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.681996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.682422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:13.818320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:13.827471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:13.829060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:13.830242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-18e4807f-4bc2-4b4b-a977-b2ac1acc909b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.162167 Aug 23 22:37:13.830994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 316/610] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:13.858006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:13.858650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:13.864770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.865292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.865770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:13.866459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:13.866913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:13.867333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:14.006596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:14.015121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a78a40bf-dac0-4d11-9919-1387514b3204 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.160994 Aug 23 22:37:14.015699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 317/611] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:13 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:14.306523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:14.307329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:14.322349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:14.322349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:14.322349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:14.322349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:14.322834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:14.322834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:14.477551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:14.485967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-25313ffb-7419-4a66-9019-0ebff2476a1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.183806 Aug 23 22:37:14.486539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 318/612] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:14.854720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:14.858488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:14.861576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:14.862057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:14.862482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:14.863166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:14.863605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:14.864016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:14.921713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4678e934-9c3b-43b9-9fa4-dc10df31a76c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "POST /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.688596 Aug 23 22:37:14.923933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 295/613] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:37:11 2022] POST /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c/os-volume_attachments => generated 194 bytes in 3690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:15.024329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:15.031714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:15.033704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:15.034909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eb6887ec-0c42-4fae-b2fb-40c318622acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.184844 Aug 23 22:37:15.035654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 319/614] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:15.045229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:15.045229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:15.049913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:15.051440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:15.051440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:15.051756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:15.052212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:15.052633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:15.199864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:15.208355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e04e02cb-dd51-4788-95df-be00960ea534 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.170540 Aug 23 22:37:15.209563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 296/615] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:15 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:15.511736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:15.512681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:15.520019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:15.520488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:15.520925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:15.521641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:15.522085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:15.522499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:15.660093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:15.668656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0c6833c1-17ee-42ff-870b-108f41e2c1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.163385 Aug 23 22:37:15.669328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 320/616] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:16.060493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:16.061183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:16.068203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.068915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.069539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.070265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.070723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.071257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.210474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:16.219459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:16.221000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:16.222189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8e4ad593-602a-4e8b-bb38-60ff23714c30 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.166253 Aug 23 22:37:16.222830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 297/617] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:16.234101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:16.234101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:16.238142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.238731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.239236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.240035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.240557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.241077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.378800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:16.387203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3541ae1-7212-4bcf-86e2-641aeb35ea26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.160769 Aug 23 22:37:16.387794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 321/618] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:16 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:16.426021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "name": "network-vif-plugged", "status": "completed", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:16.439085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.439246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.439763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.452094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] Creating event network-vif-plugged:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:37:16.457216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-02de1992-0ba0-4f02-94b7-aa53de728c9a req-23ee11de-812d-418b-9758-f435d7077e84 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Aug 23 22:37:16.457813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 298/619] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:16.693298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:16.693834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:16.700816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.701355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.706579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.706579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:16.706579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:16.706579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:16.842861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:16.850853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e832a6e3-88f4-4522-8780-d2099c518a2d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.161477 Aug 23 22:37:16.851472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 322/620] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:17.247626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:17.248300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:17.254532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.255017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.255432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:17.256105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.256549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.256960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:17.395241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:17.399100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:17.400651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:17.401838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-51095db6-b2d3-431d-87c0-23c0714030f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.159548 Aug 23 22:37:17.402399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 299/621] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:17.410861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:17.411607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:17.418138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.418612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.419036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:17.419713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.420154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.420565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:17.554465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:17.563275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-37c71627-09f5-40f8-ac99-40697b9dda4c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.156250 Aug 23 22:37:17.563847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 323/622] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:17 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:17.872360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:17.872894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:17.878874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.879360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.879872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:17.880553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:17.881028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:17.881456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:18.018264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:18.027108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7cc3ea5b-a21e-4bb8-ae1e-d59bfb5ce0ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1358 microversion: 2.1 time: 0.158652 Aug 23 22:37:18.027686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 300/623] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:18.426316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:18.426867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:18.433826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:18.434441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:18.434808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:18.435564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:18.435967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:18.436392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:18.574183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:18.583298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:18.584822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:18.586005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-36533bfd-1870-4e45-8f1c-06800ab1af99 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.163797 Aug 23 22:37:18.587025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:18.587505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 324/624] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:18.589309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:18.596528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:18.598960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:18.598960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:18.598960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:18.598960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:18.599383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:18.739733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:18.747916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d80b7504-8536-4acb-9099-b1955d5059e6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.165471 Aug 23 22:37:18.748478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 301/625] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:18 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:19.048028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.048663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:19.054643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.055126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.055563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.056256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.057379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.057806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.061968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:19.197797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.205738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6396442f-2889-461f-868c-7c4d36adf508 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1547 microversion: 2.1 time: 0.161528 Aug 23 22:37:19.206322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 325/626] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:19.229132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.230107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:19.237651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.238146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.238591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.239296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.239963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.240398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.381549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.390112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3e5ca615-2412-48a7-8790-2ef40c6a523a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1547 microversion: 2.1 time: 0.165829 Aug 23 22:37:19.390673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 302/627] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:19.410680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.415392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.417063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Searching by: {'deleted': False, 'project_id': '754172385f004ede86566e52cddf1d47'} {{(pid=121884) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 22:37:19.423845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.424321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.424751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.425531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.425988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.426414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.517944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.multi_cell_list [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 22:37:19.610558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.611189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:19.617713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.618263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.618698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.619845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.620379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.620498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-94b99bfa-4805-43cc-bfa2-14fc10f1e0b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213654 Aug 23 22:37:19.620806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.621311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 326/628] 10.222.0.73 () {58 vars in 1125 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:37:19.632124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.632760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:19.641535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.642028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.642471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.643190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.643690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.644116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.762386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.771276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.772877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.774076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-084aa4b5-566c-4b4b-aa24-60d81c477e86 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.167506 Aug 23 22:37:19.774642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 303/629] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:19.780026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:19.781064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:19.783368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.787319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.788029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.788457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.790824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:19.790824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:19.790824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:19.792437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-afb463a3-90e6-45ce-b17b-cb3b20f17df6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1547 microversion: 2.1 time: 0.164032 Aug 23 22:37:19.793025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 327/630] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:19.940922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:19.954282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-409bd654-d4d0-468c-8cbb-2f6e6dab1e7d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.178535 Aug 23 22:37:19.954853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 304/631] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:19 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:20.799171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:20.799869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:20.806730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:20.807345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:20.807950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:20.808638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:20.809119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:20.809542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:20.945678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:20.954772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:20.956280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:20.957499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4fef10ca-7a2f-4486-91aa-7478951e115e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.162242 Aug 23 22:37:20.958060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 328/632] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:20.978430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:20.979037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:20.985798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:20.986279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:20.986725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:20.987391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:20.987970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:20.988383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.130342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:21.138198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f5cd04d4-4e18-4aaa-9cc3-a72f004e5661 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.164757 Aug 23 22:37:21.138850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 305/633] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:20 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:21.328052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:21.330353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:21.336188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.336925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.337756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.338636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.339093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.339543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.364562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'flavor' on Instance uuid 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:37:21.828906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-86420837-9028-44d6-a819-ebf027950021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action" status: 200 len: 32 microversion: 2.1 time: 0.504664 Aug 23 22:37:21.830312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 329/634] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:37:21 2022] POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action => generated 32 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:37:21.840039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:21.840987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:21.846757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.847674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.848122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.848817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.849424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.849844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.981716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:21.982280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:21.982779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:21.989180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.989676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.990105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.990965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:21.991568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:21.991742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3c3b07b7-7b73-42b6-928a-85120ca9b70f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.156524 Aug 23 22:37:21.991994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:21.999842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 306/635] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:22.160279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:22.160928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:22.168022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:22.168506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:22.168939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:22.169692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:22.170138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:22.170555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:22.216327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:22.225398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:22.226914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:22.228243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-28b4c6da-9ad2-43c6-9449-64bc50bda4f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.250950 Aug 23 22:37:22.228804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 330/636] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:22.317385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:22.326243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-528eb3d4-b5d5-4dc5-b51d-9527da9f9136 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.170024 Aug 23 22:37:22.326973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 307/637] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:22 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:23.014465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:23.015078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:23.021442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.021968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.022409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.023235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.023570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.024034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.036387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4941c8d3-f0b7-414b-a921-ab428f21bfd8"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:23.038872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:23.046382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.046882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.047358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.048096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.048571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.048988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.066370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:23.160485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:23.169728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3a46c27e-3e1e-4bd8-9245-3f3960ca8f76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159274 Aug 23 22:37:23.170297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 331/638] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:23.250959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:23.251495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:23.257596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.258084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.258525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.259271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.259744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.260265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.390833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:23.399075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:23.401261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:23.402411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b7460f4-5f42-481b-9bd2-16b61ca3229f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.155859 Aug 23 22:37:23.403014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 332/639] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:23.407431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:23.408062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:23.414005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.414495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.414931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.415656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:23.416107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:23.416536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:23.550748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:23.559807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f53cf828-f3ae-4b6d-9cf1-76590bf8e9f8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1676 microversion: 2.1 time: 0.155782 Aug 23 22:37:23.560396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 333/640] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:23 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:24.190764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:24.191402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:24.198258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.199555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.199988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.200688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.201173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.201593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.252352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b2aa7004-9eff-4988-a898-3d5de872241e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.219628 Aug 23 22:37:24.253059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 308/641] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 22:37:23 2022] POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 194 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:37:24.340841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:24.349388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ed4fafa-b11d-4140-9095-0008e13bbe0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.162454 Aug 23 22:37:24.349990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 334/642] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:24.426334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:24.427058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:24.433902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.434391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.434828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.435564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.436015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.436469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.573585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:24.580889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:24.581743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:24.582212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:24.585043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:24.586382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca9fd869-978a-42b3-bc47-2b22b2f14dee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.164424 Aug 23 22:37:24.587241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 309/643] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:24.589819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.590300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.590731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.591420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.591865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.592289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.725200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:24.733528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d6b9783-6e17-4007-9c1f-cba002cbb300 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1653 microversion: 2.1 time: 0.156508 Aug 23 22:37:24.734096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 335/644] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:24 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:24.754619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:24.760685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:24.761229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:24.761660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:24.783565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Going to try to start instance {{(pid=121885) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 22:37:25.108675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b9bb6925-3732-48b4-ae50-9170906aa2d7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action" status: 202 len: 0 microversion: 2.1 time: 0.357717 Aug 23 22:37:25.109240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 310/645] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:37:24 2022] POST /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:37:25.117247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:25.117856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:25.123989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.124480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.124939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.125698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.126150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.126568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.263668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:25.271949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-69867723-f16f-43ae-b2d5-1a07f3923b1d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1662 microversion: 2.1 time: 0.158497 Aug 23 22:37:25.272525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 336/646] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:25 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:25.375979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:25.376770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:25.383520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.385932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.385932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.385932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.385932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.386346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.526025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:25.535900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a05c8943-bf0e-46a9-a017-5e41900110c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.164267 Aug 23 22:37:25.537089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 311/647] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:25.609813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:25.610512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:25.616665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.617261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.617767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.618784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:25.619089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:25.619577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:25.833666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:25.842663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:25.844182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:25.845502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-58817424-7542-446c-9fce-8d818cf9d1d0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.239462 Aug 23 22:37:25.846242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 337/648] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:26.296223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:26.297182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:26.303519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.304007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.304444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:26.305297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.305774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.306202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:26.444515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:26.452942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-43e1332d-4a51-40de-a061-afebcd5769e2 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1662 microversion: 2.1 time: 0.161701 Aug 23 22:37:26.453599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 312/649] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:26 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:26.557631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:26.558181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:26.566806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.567311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.567748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:26.568443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.568924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.569438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:26.714876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:26.724770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9395fc7e-a6b7-46d5-b038-49891bfbe477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.171100 Aug 23 22:37:26.726318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 338/650] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:26.868900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:26.869452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:26.876091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.876576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.877005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:26.877706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:26.878183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:26.878718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:27.010911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:27.019639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:27.021207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:27.022426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6a98e5a-7df3-484a-82d7-0fe746449096 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.157573 Aug 23 22:37:27.023006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 313/651] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:27.475559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:27.476186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:27.482484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:27.483021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:27.489908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:27.489908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:27.489908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:27.489908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:27.512658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:27.628013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:27.635682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-575d838b-b373-475d-bb3c-4344da38255f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1666 microversion: 2.1 time: 0.163964 Aug 23 22:37:27.636250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 339/652] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:27 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:27.747268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:27.747985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:27.754793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:27.755292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:27.755729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:27.756429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:27.757057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:27.757491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:27.894130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:27.902322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1167e29b-a737-4ffa-9539-6e2aa3776e84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159491 Aug 23 22:37:27.902927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 314/653] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:28.047437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:28.048037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:28.054620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:28.055098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:28.055527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:28.056207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:28.056650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:28.057097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:28.190358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:28.198818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:28.200462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:28.201638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-417e6b57-af71-4cf7-aee1-0b0aa8632626 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.158276 Aug 23 22:37:28.202201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 340/654] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:28.923758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:28.924362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:28.930906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:28.931378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:28.931806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:28.932485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:28.932935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:28.933380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:29.063048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:29.071463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9711c115-65b4-4c80-a897-654f29416ab4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.151533 Aug 23 22:37:29.072081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 315/655] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:29.224676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:29.225368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:29.231959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:29.232527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:29.232969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:29.233943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:29.234479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:29.234903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:29.369370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:29.378848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:29.380362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:29.381587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ee8ea4a5-f192-4406-a73b-d254600818e4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1722 microversion: 2.20 time: 0.160814 Aug 23 22:37:29.382322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 341/656] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:30.094881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:30.095500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:30.102466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:30.102939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:30.103398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:30.104081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:30.104541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:30.104965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:30.242716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:30.250869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ef193880-4867-4233-b935-f2037d1adf14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.161308 Aug 23 22:37:30.251422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 316/657] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:30.412750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:30.413429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:30.415274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:30.420196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:30.421682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:30.421682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:30.422355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:30.422802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:30.423217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:30.558018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:30.566814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:30.568417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:30.569599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a8893c64-7fbf-437f-8286-4a9834cd19b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.161004 Aug 23 22:37:30.570285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 342/658] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:31.272188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:31.272882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:31.279350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:31.279836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:31.280314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:31.281060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:31.281519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:31.281944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:31.414268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:31.423359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f7574cac-54cf-4586-b31d-2d81d9cc8c0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.155256 Aug 23 22:37:31.423920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 317/659] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:31.595832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:31.596449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:31.603193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:31.603677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:31.604114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:31.604807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:31.605297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:31.605879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:31.739421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:31.747715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:31.749283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:31.751088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1ff861b-03c9-44c7-8b12-89d07cffa1f0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160258 Aug 23 22:37:31.751669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 343/660] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:32.443843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:32.444440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:32.450816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:32.451291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:32.451719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:32.452399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:32.452900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:32.453348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:32.596804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:32.604987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9da5fef6-a133-4dc8-a39c-c90f9fa99998 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.165035 Aug 23 22:37:32.605579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 318/661] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:32.782058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:32.782058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:32.783426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:32.784014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:32.784587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:32.785397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:32.785909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:32.786339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:32.921068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:32.929973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:32.931518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:32.932676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c091dfb9-0ca8-465e-a0a2-9d64fe271f93 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.161256 Aug 23 22:37:32.933276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 344/662] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:33.627149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:33.627843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:33.634381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:33.634864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:33.635283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:33.635957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:33.636399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:33.636815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:33.770729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:33.778884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3f3e5dbd-112a-4331-8451-995fabb1157f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.156161 Aug 23 22:37:33.779451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 319/663] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:33.956067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:33.956685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:33.963745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:33.964263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:33.964700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:33.965432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:33.965896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:33.966319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:34.111383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:34.119863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:34.121377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:34.122518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7216e197-c14e-45f2-ba83-6b5ee7ee99d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.170586 Aug 23 22:37:34.123067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 345/664] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:34.542627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "name": "network-vif-plugged", "status": "completed", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:34.564357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:34.564357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:34.564357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:34.568602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] Creating event network-vif-plugged:5c6bb5ba-892a-4226-aaf9-01d9d08525ab for instance e4822c04-cfe2-4f63-b2db-42c5011791cc on hv-cinder-84254 Aug 23 22:37:34.574101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-f407706b-d994-4306-aeca-9a30405a58ac req-fa6af29c-2677-48cc-afa8-af024d7f9c08 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Aug 23 22:37:34.574907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 320/665] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:34.799823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:34.800487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:34.806672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:34.807158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:34.807592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:34.808285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:34.808734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:34.809194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:34.946953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:34.955963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4b002235-c559-42ef-898b-7cd0da099737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.160089 Aug 23 22:37:34.956551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 346/666] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:35.146551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:35.147160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:35.154106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:35.154596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:35.155028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:35.155736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:35.156196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:35.156643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:35.293920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:35.303656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:35.305215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:35.306419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-44a532c7-2b30-4fd4-84f2-a6c57dcd6cc2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.164243 Aug 23 22:37:35.306987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 321/667] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:35.977743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:35.978462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:35.985067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:35.985553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:35.985986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:35.986680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:35.987129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:35.987547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:36.137365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:36.146812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3cbeb8fd-51a3-4016-bece-3e67cfc854a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.172797 Aug 23 22:37:36.147396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 347/668] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:36.330493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:36.331087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:36.338113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:36.338599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:36.339030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:36.339724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:36.340171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:36.340593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:36.475780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:36.484649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:36.487192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:36.488393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-25d29259-1155-4ce1-a00f-9f10c0ad01c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.162825 Aug 23 22:37:36.488946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 322/669] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:37.167957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:37.168576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:37.175156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:37.175645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:37.176086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:37.176787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:37.177273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:37.177702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:37.309421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:37.318329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-699db788-0116-486e-976e-6d899a84a0a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154206 Aug 23 22:37:37.318907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 348/670] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:37.513085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:37.513637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:37.516168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=72 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:37.520973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:37.521499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:37.521945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:37.522646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:37.523098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:37.523517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:37.542899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:37.658218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:37.666646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:37.668155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:37.669594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ba7dec1-235f-43c7-a7ec-5997b17dccac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160305 Aug 23 22:37:37.669973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 323/671] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:38.340017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:38.340554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:38.347203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:38.347693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:38.348133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:38.348835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:38.349319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:38.349741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:38.484764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:38.493531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-860f16fb-0264-4e2f-9af2-bb404392b9f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.157538 Aug 23 22:37:38.494835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 349/672] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:38.693279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:38.693881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:38.700745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:38.701270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:38.701688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:38.702908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:38.703336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:38.703752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:38.847398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:38.855663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:38.857199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:38.858355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57e87bbf-a233-4825-8406-f121bc398389 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.169089 Aug 23 22:37:38.858923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 324/673] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:39.516628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:39.517260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:39.523704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:39.524181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:39.524610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:39.525321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:39.525770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:39.526181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:39.660767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:39.669385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b55f4546-071b-44ff-a0f3-48ff22ebbb19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.157063 Aug 23 22:37:39.669953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 350/674] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:39.881802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:39.882348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:39.888736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:39.889261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:39.889704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:39.891190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:39.891649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:39.892074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:40.023500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:40.031967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:40.033499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:40.034660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9d7c9403-5d2e-4016-97c8-6d8b7b070c6f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.156865 Aug 23 22:37:40.035219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 325/675] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:40.692694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:40.693287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:40.695585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=88 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:40.700163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:40.700638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:40.701097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:40.701777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:40.702217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:40.703419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:40.839487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:40.848038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c7306ad9-b12f-42c3-bd4d-83d1c2213867 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159218 Aug 23 22:37:40.848618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 351/676] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:41.057252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:41.057836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:41.065123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:41.065610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:41.066049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:41.066733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:41.067182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:41.067640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:41.199409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:41.207952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:41.209497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:41.210664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-76dd694e-c2ca-4e36-b410-678a7e0f10da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.157455 Aug 23 22:37:41.211479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 326/677] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:41.870155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:41.870723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:41.877530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:41.878034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:41.878468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:41.879154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:41.879598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:41.880011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:42.017513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:42.025947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-39720f2c-62a6-47cc-8b7c-3a41bed8877e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159791 Aug 23 22:37:42.026530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 352/678] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:42.234861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:42.235474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:42.242083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:42.242575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:42.243015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:42.243718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:42.244195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:42.244625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:42.383871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:42.392787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:42.394312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:42.395480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b8f32549-b0bf-4420-a89f-436732979905 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.165256 Aug 23 22:37:42.396092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 327/679] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:43.051320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:43.051940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:43.058322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:43.058807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:43.059236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:43.059916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:43.060363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:43.060775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:43.195613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:43.205032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-73b4976c-a860-4c5c-990e-c7b19f2858b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.158809 Aug 23 22:37:43.205666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 353/680] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:43.419376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:43.420035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:43.426854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:43.427363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:43.427797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:43.428480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:43.428956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:43.429519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:43.558235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:43.567203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:43.568740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:43.569947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-59791fb9-0ee0-4ecd-9870-43bd715373e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.154451 Aug 23 22:37:43.570503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 328/681] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:44.227496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:44.228092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:44.234565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.235033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.235455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.236131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.236573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.236987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.373222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:44.382183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b37e82a0-a20e-4776-877a-1b0b6fc3f199 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.158398 Aug 23 22:37:44.382919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 354/682] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:44.593085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:44.593901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:44.600483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.600965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.601454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.602120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.602566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.602986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.754301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:44.754301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:44.754680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:44.755817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8884363b-74af-4650-8290-935ecd5d6a1d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.166588 Aug 23 22:37:44.756435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 329/683] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:45.408880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:45.409511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:45.415942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.416427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.416862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:45.417608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.418059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.418501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:45.552554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:45.561218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-474d54fd-b02a-4959-99e4-418a8d5e6b7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.157005 Aug 23 22:37:45.562050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 355/684] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:45.779717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:45.780324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:45.787148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.787685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.788186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:45.788759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.789242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.789660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:45.924918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:45.933212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:45.934644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:45.935832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7d21c83c-cfef-4843-bc33-287ae3ea32d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160063 Aug 23 22:37:45.936403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 330/685] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:46.582901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:46.583540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:46.590392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:46.590867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:46.591297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:46.591983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:46.592664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:46.593253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:46.603841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:46.732796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:46.741369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-06531e5b-8e65-47e7-a159-39bbde819f63 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.162294 Aug 23 22:37:46.747200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 356/686] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:46.958553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:46.959154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:46.966190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:46.966672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:46.967103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:46.967818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:46.968268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:46.968688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.104478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:47.114047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:47.117253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:47.117253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-549b3049-42c9-4118-ab3b-81c5c953323a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.162196 Aug 23 22:37:47.117462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 331/687] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:37:47.762792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:47.763433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:47.771383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:47.771870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:47.772309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.773022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:47.773484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:47.773908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.906805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:47.915334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26a5cc2e-0b32-4cf2-9203-152272923b38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.156467 Aug 23 22:37:47.915913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 357/688] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:48.141700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:48.142219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:48.148769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.149364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.149745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:48.150436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.150889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.151313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:48.288848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:48.297377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:48.298874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:48.300024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7df6843b-9eaf-4070-94e9-0f920f41e076 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.163039 Aug 23 22:37:48.300590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 332/689] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:48.935875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:48.936626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:48.943372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.943883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.944352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:48.945063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.945518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.945938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:49.078008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:49.086413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a373c19-4393-43d8-941b-fe079e46d2f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154552 Aug 23 22:37:49.086972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 358/690] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:49.323673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:49.324304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:49.331658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:49.332150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:49.332585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:49.333309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:49.333765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:49.334191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:49.470330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:49.478694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:49.480209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:49.481412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6a837388-5f72-4ffe-ab34-56486b72d1ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.161662 Aug 23 22:37:49.481981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 333/691] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:50.107831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:50.109193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:50.115694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:50.116170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:50.116600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:50.117317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:50.117760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:50.118176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:50.260139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:50.269283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d6defdea-4ba1-4202-a677-f2b73d16ea9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.165323 Aug 23 22:37:50.269860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 359/692] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:50.504575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:50.505219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:50.511911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:50.512321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:50.512753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:50.513503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:50.513957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:50.514531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:50.652918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:50.662145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:50.663640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:50.664802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1cf8e324-84b8-4cc3-a1a8-390aa21b756a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.164183 Aug 23 22:37:50.665403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 334/693] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:51.291502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:51.292043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:51.298827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.299302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.299730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.300415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.300865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.301315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.432292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:51.441344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cd0338bf-29e8-4ae9-9aaf-9aedc5a686e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.153732 Aug 23 22:37:51.441912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 360/694] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:51.689379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:51.689985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:51.696680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.697217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.697686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.698388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.698843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.699268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.832861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:51.840265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:51.841805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:51.843770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b949b742-b83f-403c-8064-fc9e35fc576c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.159800 Aug 23 22:37:51.844321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 335/695] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:51 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:52.462405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:52.463017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:52.470390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:52.470912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:52.471351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:52.472070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:52.472553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:52.472977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:52.613370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:52.621878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4c681fe-bcff-466b-9e59-70c3e73b10a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.163572 Aug 23 22:37:52.622480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 361/696] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:52.867661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:52.868307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:52.875510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:52.876425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:52.876425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:52.877175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:52.877654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:52.878094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:53.012032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:53.020539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:53.022072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:53.023219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-10a0eff0-fa60-462f-a2e0-8b8c56fc89a8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.159454 Aug 23 22:37:53.023780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 336/697] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:53.644192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:53.644831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:53.651526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:53.652013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:53.652450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:53.653172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:53.653628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:53.654052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:53.792209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:53.801373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a3f4dcb-61ef-4952-a183-86b5a800cd5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.160932 Aug 23 22:37:53.801953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 362/698] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:54.046545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:54.047175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:54.053723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.054207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.054638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.055328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.055780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.056275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.192663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:54.201233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:54.202880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:54.204039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b9aeab2a-efcd-40f7-a8d7-ffeaeaaf4986 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.162002 Aug 23 22:37:54.204712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 337/699] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:54.825430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:54.826028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:54.833436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.833922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.834360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.835567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.835980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.836416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.978822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:54.987576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d06b097-71b8-4816-a939-0beade27308d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.167052 Aug 23 22:37:54.991221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 363/700] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:55.227920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:55.228528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:55.235944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:55.236430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:55.236865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:55.237585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:55.238034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:55.238452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:55.371778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:55.381491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:55.382911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:55.384058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eb514641-5b0d-469e-a7f5-e1f005478b74 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160134 Aug 23 22:37:55.384611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 338/701] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:56.012248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:56.012912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:56.019486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.019973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.020411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.021154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.021612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.022036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.175405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:56.184059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7618b906-124d-446e-ae6b-a0755aea32df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.175619 Aug 23 22:37:56.184612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 364/702] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:56.408501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:56.409161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:56.415646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.416139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.416571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.417281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.417734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.418179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.581634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:56.590383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:56.591890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:56.594380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b2bc1a89-2207-4e7d-af77-0b4f398634a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.190149 Aug 23 22:37:56.594958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 339/703] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:57.208270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:57.208879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:57.215590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:57.216075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:57.216509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:57.217411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:57.217972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:57.218473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:57.346818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:57.354965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4bd78464-0c62-41d6-92f1-8041fee31888 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.153207 Aug 23 22:37:57.355529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 365/704] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:57.617947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:57.618477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:57.626087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:57.626578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:57.627019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:57.627712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:57.628166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:57.628588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:57.632668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:57.764047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:57.772299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:57.773857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:57.775007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57c18200-0fbf-42a5-a11b-1ec853230775 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.161197 Aug 23 22:37:57.775559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 340/705] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:58.376323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:58.376927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:58.383290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:58.383752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:58.384182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:58.384854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:58.385329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:58.385747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:58.522026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:58.530632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c22089a3-76d9-4019-853a-7a284ba8b822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.157852 Aug 23 22:37:58.531374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 366/706] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:58.798470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:58.799003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:58.807681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:58.808526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:58.809317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:58.810042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:58.810513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:58.811435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:59.192457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:59.203420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:59.204913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:59.206186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0dfb151d-06ec-4097-a99b-08e7c1823ca9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.411765 Aug 23 22:37:59.206765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 341/707] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:37:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:37:59.552392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:59.553033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:59.561329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:59.561829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:59.562397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:59.563103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:59.563595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:59.563988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:59.701063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:59.710461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-05c601d4-37a2-4b54-80e0-1858d16554a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.161709 Aug 23 22:37:59.711037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 367/708] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:00.230022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:00.230714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:00.237610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:00.238096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:00.238538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:00.239264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:00.239717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:00.240140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:00.378088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:00.386878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:00.388388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:00.389600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3dd10d40-c3c7-4c28-be60-3428e86c6def tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.163600 Aug 23 22:38:00.390161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 342/709] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:00.731801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:00.732420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:00.739215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:00.739700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:00.740136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:00.740828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:00.741317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:00.741737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:00.876769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:00.885397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8bc2b228-387a-4363-96b9-4c3535261f2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.157443 Aug 23 22:38:00.885979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 368/710] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:01.412585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:01.413291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:01.419685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:01.420156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:01.420674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:01.421500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:01.421946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:01.422368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:01.556722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:01.565582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:01.567091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:01.568309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a220e473-e538-41a1-9fc2-f677e1e23d97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.159639 Aug 23 22:38:01.568814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 343/711] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:01.907564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:01.908177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:01.914976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:01.915145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:01.915549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:01.916172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:01.916618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:01.917127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:02.053964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:02.062995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf61b993-4b18-439e-946f-baf99d0fecda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159435 Aug 23 22:38:02.063576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 369/712] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:02.591946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:02.592553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:02.602635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:02.603158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:02.603583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:02.604281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:02.604724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:02.605178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:02.741183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:02.749808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:02.751481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:02.752653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2c6e86b1-d794-4317-9ac0-caa4f7a45d2f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.164796 Aug 23 22:38:02.753249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 344/713] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:03.085078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:03.085687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:03.092392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:03.092876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:03.093344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:03.094346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:03.094853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:03.095277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:03.238678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:03.247550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd22b4f1-1e18-4563-938a-d5def4cc9f64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.166808 Aug 23 22:38:03.248109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 370/714] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:03.776185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:03.776797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:03.783979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:03.784463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:03.784896 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:03.785621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:03.786077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:03.786497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:03.919904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:03.929667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:03.931187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:03.932321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-131ecfcc-63df-4a5d-80b6-ff84f086e09a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160391 Aug 23 22:38:03.932877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 345/715] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:04.270464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:04.271124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:04.277605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:04.278090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:04.278533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:04.279218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:04.279672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:04.280095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:04.411994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:04.421156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d56e1446-5164-4844-861f-e0996c03a3ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.155344 Aug 23 22:38:04.421828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 371/716] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:04.956449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:04.957133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:04.963791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:04.964277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:04.964714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:04.965437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:04.965902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:04.966323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:05.105602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:05.114401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:05.115955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:05.117147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-53708c18-d2ab-4259-a09b-641c1e188a1c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.165527 Aug 23 22:38:05.117720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 346/717] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:05.443992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:05.444577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:05.451239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:05.451733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:05.452168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:05.452870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:05.453404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:05.453831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:05.591752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:05.595998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:05.601502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-179776ae-2188-4531-bfb5-5866b00e02ef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.161403 Aug 23 22:38:05.602119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 372/718] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:06.140297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:06.140839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:06.147613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:06.148099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:06.148586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:06.149293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:06.149747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:06.150171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:06.279836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:06.289127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:06.290643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:06.291802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6aedf4f4-8e4c-43e8-8833-8790ff038acb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.155564 Aug 23 22:38:06.292361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 347/719] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:06.623561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:06.624171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:06.632049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:06.632531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:06.632962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:06.633682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:06.634123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:06.634538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:06.774191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:06.783263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-55b6ce41-ad08-4b6e-84b0-1596f3022686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.163877 Aug 23 22:38:06.783837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 373/720] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:07.317358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:07.318034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:07.324782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:07.325303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:07.325754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:07.326456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:07.326913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:07.327339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:07.486813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:07.501590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:07.503107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:07.504281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9cfbcc66-7050-45d0-870a-71019f22cd2d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.192454 Aug 23 22:38:07.504847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 348/721] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:07.805951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:07.806558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:07.813728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:07.814222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:07.814686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:07.815399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:07.815889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:07.816315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:07.959123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:07.975468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fa48a816-546b-4c2a-ba89-af82c329f987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.172910 Aug 23 22:38:07.976527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 374/722] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:08.528070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:08.528680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:08.531167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=52 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:08.536557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:08.537076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:08.537520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:08.538281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:08.538736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:08.539196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:08.670033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:08.679023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:08.680506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:08.681668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6af9b3f7-69cf-444d-8452-71d3415a698a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.157556 Aug 23 22:38:08.682218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 349/723] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:08.999210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:09.000393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:09.006954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:09.007433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:09.007859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:09.008539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:09.008983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:09.009423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:09.139088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:09.148332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5e9956e4-2b40-4c03-99a3-cf3a9614fc36 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.152934 Aug 23 22:38:09.148904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 375/724] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:09.705383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:09.705986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:09.712695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:09.713216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:09.713654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:09.714349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:09.714802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:09.715227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:09.849827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:09.858095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:09.860705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:09.862579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7a13333e-b3d5-4545-a90a-311d7c085eb4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.161066 Aug 23 22:38:09.863119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 350/725] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:10.169839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:10.170368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:10.177024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:10.177514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:10.177975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:10.178644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:10.179096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:10.179519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:10.315177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:10.324013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1a6b1f07-fcfc-46dd-b48f-12be16a98176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.158107 Aug 23 22:38:10.324572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 376/726] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:10.885818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:10.886434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:10.893774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:10.894268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:10.894705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:10.895403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:10.895858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:10.896281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:11.026111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:11.034951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:11.036431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:11.037607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2a203799-80a3-472a-a07e-bff5891bb428 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.156265 Aug 23 22:38:11.038164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 351/727] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:11.347093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:11.347703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:11.350037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=52 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:11.354678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:11.355163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:11.355606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:11.356293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:11.356744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:11.357233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:11.486784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:11.496734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f2d2c13a-1aaa-45d2-9656-de8e9a60ba56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.153520 Aug 23 22:38:11.497336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 377/728] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:12.065734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:12.066343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:12.072708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:12.073230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:12.073670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:12.074361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:12.074817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:12.075242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:12.208911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:12.217139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:12.219289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:12.220501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-264544a5-97f0-4959-87d6-3e2db7b904aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.158695 Aug 23 22:38:12.221317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 352/729] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:12.521494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:12.522014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:12.528386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:12.528862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:12.529333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:12.530017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:12.530462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:12.531567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:12.663273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:12.672801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c046ad8b-8452-4f68-abc8-ff3448c154fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154396 Aug 23 22:38:12.673624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 378/730] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:13.243758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:13.244291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:13.250831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:13.251316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:13.251753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:13.252443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:13.252897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:13.253352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:13.387695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:13.396879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:13.398719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:13.399642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-db6ed402-8e0b-45de-852e-2294d95def0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.159948 Aug 23 22:38:13.400210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 353/731] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:13.695949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:13.696568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:13.707285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:13.707788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:13.708232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:13.708947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:13.709694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:13.710222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:13.841166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:13.850249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-106a716f-0f3e-4006-8eee-d415bdffb86c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.158319 Aug 23 22:38:13.850820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 379/732] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:14.423471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:14.424118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:14.430533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:14.431016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:14.431455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:14.432144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:14.432595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:14.433037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:14.565876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:14.573961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:14.575464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:14.576644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0eba6061-2d2b-4949-b006-a1ada4f3fa7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.157304 Aug 23 22:38:14.577230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 354/733] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:14.871900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:14.872566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:14.880133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:14.880619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:14.881115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:14.881812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:14.882304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:14.882729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:15.246757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:15.255208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6828c151-4385-4079-98a7-be9f6952e927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.387192 Aug 23 22:38:15.255772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 380/734] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:15.600489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:15.601152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:15.607716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:15.608201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:15.608640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:15.609536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:15.609992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:15.610417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:15.748272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:15.757871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:15.759401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:15.760544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-071dc810-cc63-4739-872b-44dfcec9c03b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.164066 Aug 23 22:38:15.761255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 355/735] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:16.277887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:16.278639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:16.285310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:16.285790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:16.286220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:16.286900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:16.287342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:16.287757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:16.418794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:16.427987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-799476b4-ddff-4858-bd62-38958dab03e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154312 Aug 23 22:38:16.428557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 381/736] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:16.784401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:16.785167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:16.791765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:16.792426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:16.792864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:16.793623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:16.794079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:16.794501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:16.921533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:16.924947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:16.930075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:16.931608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:16.932791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f9a95b26-3746-45b5-bf8a-4e5f37613771 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.152879 Aug 23 22:38:16.933383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 356/737] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:17.457881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:17.458499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:17.465339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:17.465762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:17.466197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:17.466878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:17.467330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:17.467749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:17.597329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:17.605458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6c2efffd-3088-4a16-ba6d-24bd51386943 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.152654 Aug 23 22:38:17.606007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 382/738] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:17.961875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:17.962706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:17.969551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:17.970034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:17.970461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:17.971136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:17.971589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:17.972002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:18.101181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:18.110348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:18.111865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:18.113063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-97e7e006-20d5-487a-8600-50836797ade4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.155700 Aug 23 22:38:18.113580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 357/739] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:18.627433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:18.628032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:18.634423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:18.634901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:18.635329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:18.636009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:18.636454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:18.636867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:18.766825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:18.775232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fd239e97-35b6-4797-87dc-8da75c5b3822 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.152130 Aug 23 22:38:18.775802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 383/740] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:19.137224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:19.137811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:19.145395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:19.145913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:19.146380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:19.147132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:19.147592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:19.148035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:19.282534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:19.290823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:19.292310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:19.293478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1bf5ffc8-210b-4351-9e0f-675f5cc5523d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160640 Aug 23 22:38:19.294032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 358/741] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:19.797740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:19.798392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:19.804921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:19.805575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:19.806021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:19.806721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:19.807176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:19.807654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:19.949339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:19.958925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b5d17af9-2024-48f3-ad78-eb4426e9e9a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.165591 Aug 23 22:38:19.959747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 384/742] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:20.317371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:20.317998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:20.324503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:20.324978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:20.325440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:20.326126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:20.326573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:20.326990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:20.471089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:20.479533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:20.481058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:20.482257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a13733b7-d1bb-42f8-9a01-de527adf91a5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.168721 Aug 23 22:38:20.482877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 359/743] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:20.980626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:20.981449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:20.987935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:20.988415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:20.988840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:20.989562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:20.990008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:20.990502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:21.122717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:21.131480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f33860d8-9ba8-45d4-a4f0-33111f9beded tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154675 Aug 23 22:38:21.132042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 385/744] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:21.505805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:21.506494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:21.512973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:21.513493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:21.513930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:21.514634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:21.515731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:21.516320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:21.650591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:21.659477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:21.660980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:21.662172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f9da0f51-2c76-446c-84b2-3e22576fd916 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.160209 Aug 23 22:38:21.662757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 360/745] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:22.153342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:22.153998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:22.163234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:22.163775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:22.164165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:22.164863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:22.165346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:22.165764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:22.300698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:22.309276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e9f2e192-594a-45a0-8497-fbfc03df1fe6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159770 Aug 23 22:38:22.309843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 386/746] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:22.685530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:22.686130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:22.692634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:22.693151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:22.693581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:22.694313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:22.694760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:22.695176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:22.828687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:22.838246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:22.839733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:22.840900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1aebf09d-e5eb-4a66-bbdb-100f9d9a2b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.159777 Aug 23 22:38:22.841492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 361/747] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:23.332225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:23.332847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:23.339616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:23.340104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:23.340564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:23.341276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:23.341735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:23.342160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:23.479723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:23.488682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-18306c01-6994-4e45-b27b-d8bbcefdd44e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.160927 Aug 23 22:38:23.489396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 387/748] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:23.864909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:23.865455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:23.871930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:23.872410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:23.872839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:23.873552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:23.874704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:23.875159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:24.007388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:24.015347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:24.016850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:24.018334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b9815fd7-0782-4bc4-9f75-4ba5aa70d33e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.157148 Aug 23 22:38:24.019830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 362/749] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:24.510430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:24.511032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:24.518506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:24.518986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:24.519422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:24.520104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:24.520554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:24.521284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:24.666302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:24.674852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aa3df239-4a89-4f4e-a3b6-0b6c75cc7dd2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.168201 Aug 23 22:38:24.675430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 388/750] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:25.042542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:25.043383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:25.050320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:25.050809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:25.051246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:25.051953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:25.052407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:25.052826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:25.190398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:25.198668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:25.200164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:25.201350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c6a6c33c-038c-49bb-a56e-1299e9faec80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.163017 Aug 23 22:38:25.201910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 363/751] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:25.696014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:25.696620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:25.702467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:25.702955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:25.703390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:25.704089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:25.704532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:25.704953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:25.724379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:25.842456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:25.851490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5124aea5-ed78-4fcc-bad4-9300b475d6f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.159863 Aug 23 22:38:25.852065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 389/752] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:26.177096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:26.179319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:26.187087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.187608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.188044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.188727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.189209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.189625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.218813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c7beec98-8946-4b61-b219-1158819409bc tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045653 Aug 23 22:38:26.219377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 364/753] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:38:26 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:38:26.225143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:26.225760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:26.232274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.232659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.233149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.234177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.234680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.235137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.297226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:26.297972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:26.304074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.304561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.305047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.305814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.306264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.306683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.333070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:38:26.394867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:26.403116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:26.404882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:26.406175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f818893a-3af4-434f-b283-d00a46a1700d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.185500 Aug 23 22:38:26.406748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 390/754] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:26.804393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-94fc2cd3-69db-436f-9935-e70d67aeb441 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 204 len: 0 microversion: 2.1 time: 0.511189 Aug 23 22:38:26.805198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 365/755] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:38:26 2022] DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:38:26.822146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:26.822626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:26.829063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.829545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.829972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.830654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.831099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.831511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.873475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:26.874730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:26.880944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.884216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.884216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.884216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:26.884216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:26.884618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:26.966672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:26.975317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42f6ba85-e2ac-4e9d-9a82-c9996f895f26 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.157105 Aug 23 22:38:26.975895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 391/756] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:26 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:27.023380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:27.033148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2b962e14-b975-4668-88d6-62d9e9f58b42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.163918 Aug 23 22:38:27.033762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 366/757] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:27.429925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:27.430452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:27.436685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:27.437250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:27.437679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:27.438362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:27.438806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:27.439218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:27.578549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:27.587331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:27.588932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:27.590051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-761881a3-d3e1-4e61-9680-c304f0918752 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.164259 Aug 23 22:38:27.590602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 392/758] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:27 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:27.998413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:27.999167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:28.005622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.006109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.006536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.007229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.007678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.008100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.058149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:28.058769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:28.065142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.065679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.066064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.066753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.067199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.067621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.174119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:28.182990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce361f4c-b6c9-473c-a992-1f4949b8fe52 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.189024 Aug 23 22:38:28.183576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 367/759] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:27 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:28.225823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:28.235414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f01ec45-1dbc-4426-8743-3105f2464648 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.181083 Aug 23 22:38:28.236056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 393/760] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:28.614307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:28.614974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:28.621187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.621677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.622115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.622806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:28.623261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:28.624249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:28.773571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:28.782286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:28.783823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:28.784981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-73fe342a-dc92-430d-a272-9ef7e9d6a1b0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.174621 Aug 23 22:38:28.785587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 368/761] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:29.206061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:29.206701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:29.213398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.213872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.214302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.214985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.215431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.215840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.261568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:29.262700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:29.271287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.271771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.272212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.272930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.273401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.273815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.358020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:29.369500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11c00759-bb96-499a-8b1f-34043b55247d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.167419 Aug 23 22:38:29.370088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 394/762] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:29 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:29.417650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:29.426637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-80601cdb-031e-4f61-a2fc-054bb8dec02e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.171068 Aug 23 22:38:29.427205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 369/763] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:29.808438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:29.809065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:29.815201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.815747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.816210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.816939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:29.817460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:29.817922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:29.956970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:29.970142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:29.972681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:29.974570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-87d57f8f-0b15-4e7a-89f6-08b8c2dd5a11 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1743 microversion: 2.20 time: 0.169833 Aug 23 22:38:29.975641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 395/764] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:30.396323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:30.396995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:30.404047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:30.404545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:30.405772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:30.406321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:30.406784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:30.407215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:30.449490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:30.449490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:30.455768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:30.456418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:30.456813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:30.457554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:30.458012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:30.458461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:30.588966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:30.598062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4cb2b026-c908-44bf-a975-6cbb7af9471d tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.208791 Aug 23 22:38:30.598644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 370/765] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:30 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:30.626914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:30.635485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c799c18e-3dd1-4ab9-adc9-859f6e0c9efb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.191084 Aug 23 22:38:30.636088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 396/766] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:31.007781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:31.008667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:31.015225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.015705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.016131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.016819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.017290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.017704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.159765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:31.163436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:31.168425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:31.169957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:31.171679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f0b7c763-66e9-474e-8005-c2f1bba9ede6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.167832 Aug 23 22:38:31.172220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 371/767] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:31.619777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:31.620388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:31.627115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.627590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.628017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.628695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.629174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.629592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.657948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:31.658718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:31.666146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.666636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.667069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.668105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:31.668220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:31.668655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:31.775229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:31.782746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3d6e4d3d-e09f-42b6-9205-0f16e09de6e9 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.166760 Aug 23 22:38:31.783324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 397/768] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:31 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:31.812308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:31.820455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c4b82594-51f6-468d-a3e2-7c327f673550 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.167181 Aug 23 22:38:31.821040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 372/769] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:32.199997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:32.200697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:32.207302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.207823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.208258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.209254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.209705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.210132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.339231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:32.347628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:32.349157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:32.350386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4fdbcc61-4996-4d56-816f-eab48618eff4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.154540 Aug 23 22:38:32.353248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 398/770] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:38:32.803841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:32.804438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:32.811005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.811422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.811848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.812527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.812971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.813529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.843064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:32.843683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:32.850816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.851325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.851750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.852434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:32.852880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:32.853403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:32.983757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:32.994782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-df551c75-15df-4418-931c-53588e60bcd8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1672 microversion: 2.1 time: 0.194541 Aug 23 22:38:32.995367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 373/771] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:32 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:33.076528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:33.087908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1446b339-fea2-461f-885f-bab0ab0edd7b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.248444 Aug 23 22:38:33.088488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 399/772] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:33.373097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:33.373707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:33.380424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:33.380920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:33.381391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:33.382088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:33.382547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:33.382976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:33.585467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:33.593337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:33.595636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:33.596887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-09a18c94-4ad9-42dd-912f-8131fa2a8fb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.227759 Aug 23 22:38:33.597513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 374/773] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:34.015832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:34.017499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:34.025734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.026735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.027400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.028422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.033634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8f6ad2-07f8-4f77-81d2-70e697b1e275", "name": "network-vif-deleted", "tag": "56d68285-5ed7-44d0-af14-bbfdf7877de6"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:34.041739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.042191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.050836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.051316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.051745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.063879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] Creating event network-vif-deleted:56d68285-5ed7-44d0-af14-bbfdf7877de6 for instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 on hv-cinder-84254 Aug 23 22:38:34.069318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-ba98eed4-b144-4d39-bced-d937a3b9878b req-8845f381-b3d1-4be9-af97-7801fd94661d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039124 Aug 23 22:38:34.070288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 375/774] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:38:34.113635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:34.114333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:34.117286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.121264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.122437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.123122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.124077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.124736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.125511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.125986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-337e3fe1-5e5d-40ac-af43-813cf054a379 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1604 microversion: 2.1 time: 0.114064 Aug 23 22:38:34.126564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 400/775] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:34 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:34.293466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.302537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-711ddcbe-c5df-4e47-b9de-b5a5e1e2408e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.193146 Aug 23 22:38:34.314476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 376/776] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:34.369915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:34.370518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:34.376390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.376801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.377260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.377943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.379092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.379514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.517868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.527605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-09a7e566-866c-4fd9-a8b0-8ab577fab524 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1593 microversion: 2.1 time: 0.161310 Aug 23 22:38:34.528185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 401/777] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:34.625039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:34.625853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:34.636679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.644579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.644579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.644579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:34.644579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:34.645214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:34.846696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.856041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.858177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:34.859342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f883b333-5c87-4b6b-96a8-ae803bd9008e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.240761 Aug 23 22:38:34.860129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 377/778] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:35.153256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:35.154112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:35.171868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.172126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.177291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:35.178479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.179153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.179928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:35.326997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:35.330578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:35.334082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:35.349771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-62240ca4-9c0e-44aa-ba51-c038db424480 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1321 microversion: 2.1 time: 0.201579 Aug 23 22:38:35.351651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 402/779] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:35 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:35.352912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.357476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.357476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:35.357476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.357476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.358099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:35.723799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:35.739721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e027b939-2313-4228-a940-f389a26ff9e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.416636 Aug 23 22:38:35.741228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 378/780] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:35.886721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:35.887675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:35.895253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.896102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.896779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:35.897743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:35.898414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:35.899049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.090023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:36.102322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:36.106437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:36.109517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-031b782d-a117-42e2-af1c-2877d7b6b8a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.227646 Aug 23 22:38:36.110974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 403/781] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:36.376265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:36.380339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:36.392077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:36.392844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:36.393671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.394562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:36.395197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:36.395999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.435026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:36.435803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:36.436521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.437740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lazy-loading 'fault' on Instance uuid bb8f6ad2-07f8-4f77-81d2-70e697b1e275 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:38:36.544138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:36.559075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1bb446be-e9b4-4b8c-ab63-eb12ac99f954 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1326 microversion: 2.1 time: 0.190542 Aug 23 22:38:36.575372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 379/782] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:36 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:36.766687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:36.768105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:36.778534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:36.780161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:36.780936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.782201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:36.783226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:36.784113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:36.967941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:36.978218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-72ce8fb2-5633-44c5-a5da-02d2655b0cf4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.216139 Aug 23 22:38:36.979300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 404/783] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:37.139564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:37.141046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:37.158655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.166028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.166808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.168345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.168976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.170072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.395617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:37.404709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:37.406176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:37.407689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dfc3ea5e-0e9d-4ce4-a9a8-0202db757ed9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.273092 Aug 23 22:38:37.408232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 380/784] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:37.585173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:37.586120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:37.594555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.597189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.597189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.597568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.598343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.599118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.644713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.645368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.645970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.646620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lazy-loading 'fault' on Instance uuid bb8f6ad2-07f8-4f77-81d2-70e697b1e275 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:38:37.692358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:37.695994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:37.704731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c71a3c39-b8ed-4e9b-b1ac-31557c01b566 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 200 len: 1326 microversion: 2.1 time: 0.122867 Aug 23 22:38:37.704731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 405/785] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:37 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:37.904345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:37.932299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:37.934510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:37.936240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:37.958878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] Creating event network-changed:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:38:37.964967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-b6298307-e1a7-4411-b5cc-9def0a8b9d82 req-29855522-f4ea-4444-b68a-2af8ba22d517 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064566 Aug 23 22:38:37.965942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 381/786] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:37.999722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.002420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.009944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.010438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.011974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.013068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.013768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.014204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.258402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:38.271621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-09923ae4-c211-4a31-9982-036958b2c409 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1715 microversion: 2.1 time: 0.275630 Aug 23 22:38:38.272577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 406/787] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1715 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:38.368332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.369354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.376783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.377572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.378544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.379792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.380650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.381328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.547928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] HTTP exception thrown: Cannot 'detach_volume' instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 while it is in vm_state rescued Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Request method failure captured: Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments/10ca7eed-de9c-44d5-9c99-7b1df6b28a9c HTTP/1.1 Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUyoQVblB7pqZQfITadlzM1ri-o-yBZZnpHOwSBS14LZJtwpameZki1LHLRWS_RiuqONW5kqzyPOZXWfmAt082oZI7JQHcoKgokNcz47aJev2t2uXyIJKXsDRZn8m0PFUzDfA_pK2KUA6i4isLigyUO14m7FiuCNBjTB_ozFXTzxuc Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:38:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4f9539894f147e0912a72a1855d31bc", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: ebbf49534a8f41109f51637307270016 Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:38:38.551234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Cannot 'detach_volume' instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 while it is in vm_state rescued Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'server_id': '6bede37e-5924-4bc2-9b2f-2a29c6e24b73', 'id': '10ca7eed-de9c-44d5-9c99-7b1df6b28a9c'} Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:38:38.552029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 while it is in vm_state rescued Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 while it is in vm_state rescued Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.553345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Returning 409 to user: Cannot 'detach_volume' instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 while it is in vm_state rescued {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:38:38.559563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8686f9c4-cf61-42ec-8a7b-64bb09974b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments/10ca7eed-de9c-44d5-9c99-7b1df6b28a9c" status: 409 len: 152 microversion: 2.1 time: 0.194050 Aug 23 22:38:38.563073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 382/788] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:38:38 2022] DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments/10ca7eed-de9c-44d5-9c99-7b1df6b28a9c => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 22:38:38.588813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:38.591506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.618039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:38.628853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.629499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.635231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.635829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.636875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.638410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.641479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.641683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.642326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.642984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.645487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.646427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.646894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.647321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.838719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:38.850704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:38.857756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:38.859128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-70719c10-562c-46ae-985f-95338648f7a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.432169 Aug 23 22:38:38.859711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 407/789] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:38.866384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.867218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.880250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.888484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.889289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.890047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.890512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.890935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.919146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 HTTP/1.1 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:38:38.921157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 22:38:38.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'bb8f6ad2-07f8-4f77-81d2-70e697b1e275'} Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:38:38.923800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 22:38:38.925817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:38:38.928290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:38:38.928985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cf13a660-fcee-4cf9-acbe-e494983d05c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action" status: 202 len: 0 microversion: 2.1 time: 0.363819 Aug 23 22:38:38.933699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8aab29f8-fe6a-4c39-8613-307f88b60fa4 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 404 len: 111 microversion: 2.1 time: 0.067848 Aug 23 22:38:38.933952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 383/790] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:38:38 2022] POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:38:38.934063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 408/791] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:38 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:38:38.944481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dc3fbdcb-bab7-4776-8d18-da7e767fb7ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '.version_select at 0x7f5ed0f8f8b0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.951599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:38.956594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:38.963601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.964467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.965164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:38.966269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:38.966907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:38.967507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:39.074477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dc3fbdcb-bab7-4776-8d18-da7e767fb7ff tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870452215" status: 202 len: 0 microversion: 2.1 time: 0.136339 Aug 23 22:38:39.075065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 384/792] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 22:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870452215 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:38:39.271521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:39.280361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-62e83654-d657-4364-ac9e-72a45caee86d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1723 microversion: 2.1 time: 0.337541 Aug 23 22:38:39.295033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 409/793] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:39.885938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:39.887422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:39.896823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:39.899242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:39.899944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:39.901419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:39.902471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:39.903004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:40.157200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:40.169169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:40.170670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:40.172056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7f3f3dcc-e70a-4055-b0a9-18c31a6b1aa2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.290824 Aug 23 22:38:40.172602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 385/794] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:40.302710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:40.303459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:40.311428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:40.312049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:40.312877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:40.313823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:40.314329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:40.314842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:40.515784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:40.534476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e783ab1-c86c-42a3-9b31-7d7e8bae4da9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1723 microversion: 2.1 time: 0.235363 Aug 23 22:38:40.535722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 410/795] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:40.662978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f9eba25-d842-4124-a671-dc73790a9be0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'create', calling method: .version_select at 0x7f5ed0ddd280>, body: {"keypair": {"name": "tempest-keypair-857452113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNVBPVUzpoi8ZkAMUfLLBG9BHhZJ0mh634V4n8nqVMU0XCAFKNW2PFvOcjWveNGw0/gzhOg919S2lulnwzy3302MOGgDO+CY+QI0/5BlEe6a74AZOz8usbfy9ZSdsS3xQ=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:40.687710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-8f9eba25-d842-4124-a671-dc73790a9be0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:38:40.693583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-8f9eba25-d842-4124-a671-dc73790a9be0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for user 2ca578d6a1374212a4f1476335c641b3 and project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:38:40.795480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f9eba25-d842-4124-a671-dc73790a9be0 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139138 Aug 23 22:38:40.796834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 386/796] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 22:38:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:41.195274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:41.195890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:41.202173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:41.221891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:41.222625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:41.223578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:41.224028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:41.224689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:41.405561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:41.415697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:41.417256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:41.418756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-91423c23-91b4-460a-ad48-57fdd5011ff9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.227452 Aug 23 22:38:41.419312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 411/797] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:38:41.556337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:41.556948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:41.563110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:41.563605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:41.564046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:41.564746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:41.565372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:41.565752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:41.758936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:41.770726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5cef4c84-7f30-4a93-842b-ed4c070b434c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1723 microversion: 2.1 time: 0.218748 Aug 23 22:38:41.771304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 387/798] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:42.381990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-368752948"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:42.382844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:42.385535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=72 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:42.390679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.391431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.391933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.392989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.400301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.400301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.443963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:42.444918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:42.452643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.453168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.453617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.454320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.454944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.455523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.576530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.network.security_group_api [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Adding security group f2a0baba-c142-431e-bb47-e4f89cc560ec to port 85c5326d-185d-4f64-b484-2d2f97361b40 Aug 23 22:38:42.641421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:42.651340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:42.653139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:42.654513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb4debbd-b8f0-4884-ab67-e2b6b2eaf4be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.215571 Aug 23 22:38:42.655235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 388/799] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:42.795769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:42.796495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:42.805172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.805851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.806281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.807137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:42.807732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:42.808305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:42.966361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:42.977003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1cbca583-6640-4f60-aade-acde883d8626 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1723 microversion: 2.1 time: 0.186258 Aug 23 22:38:42.991891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 389/800] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:43.303272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e353234d-0529-4b93-a9f0-9fc24ebd44ec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action" status: 202 len: 0 microversion: 2.1 time: 0.925990 Aug 23 22:38:43.303883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 412/801] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:38:42 2022] POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:38:43.316747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:43.320728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:43.331567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:43.332307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:43.332770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:43.333992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:43.334460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:43.334878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:43.420956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:43.435070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:43.435685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:43.436283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:43.455408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] Creating event network-changed:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:38:43.490119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-5a9b1a4c-5586-400e-a029-bf242f58f017 req-1a5f15e4-3fd7-47c8-9dea-0dc0c4f54614 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152381 Aug 23 22:38:43.490119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 390/802] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:43.539577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:43.554001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3bae369a-5f6a-465f-ac83-a50e5a6dfb86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1758 microversion: 2.1 time: 0.240860 Aug 23 22:38:43.555106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 413/803] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:43.683258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:43.683990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:43.690878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:43.691569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:43.692051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:43.692981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:43.693631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:43.694057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:43.710400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:43.875054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:43.885903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:43.887765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:43.888954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aec534e0-83e8-45b0-9998-37d50caec346 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.211658 Aug 23 22:38:43.889544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 391/804] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:43.999723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:44.000945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:44.007384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.007871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.008537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.009280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.009724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.010357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.564474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:44.576681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aa8057cc-b228-4f99-9790-b8ded93628af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1729 microversion: 2.1 time: 0.580745 Aug 23 22:38:44.577551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 414/805] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1729 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:44.603970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:44.604826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:44.620310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.624637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.625229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.626030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.626565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.627065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.733533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4a3ba2d4-0f4c-42f3-9364-a0eb240073d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138439 Aug 23 22:38:44.734879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 392/806] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 22:38:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:44.856680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:44.859200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:44.868344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.868344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.868344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.868702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.868882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.869362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.915271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:44.915923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:44.929783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.930540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.931158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:44.934009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:44.934713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:44.936860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:45.123923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:45.134520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:45.136235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:45.137458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9c2d7d5e-c215-4394-a818-842939326001 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.227646 Aug 23 22:38:45.138012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 393/807] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:38:45.150939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e094bae6-57e9-4a0e-9360-0aeb65778bea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action" status: 202 len: 0 microversion: 2.1 time: 0.299094 Aug 23 22:38:45.155727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 415/808] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:38:44 2022] POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:38:45.160736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:45.161374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:45.167827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:45.168568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:45.169002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:45.169717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:45.170318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:45.170957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:45.352694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1639263905", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d6d93fc-f557-45a9-8e7c-c7d67b014366"}], "security_groups": [{"name": "tempest-securitygroup--1900322531"}], "key_name": "tempest-keypair-857452113", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:45.354053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:45.366920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-707bb42b-dc8b-4fa6-9b47-f584bb9a6f88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1750 microversion: 2.1 time: 0.210185 Aug 23 22:38:45.368148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 394/809] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:45.647102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] validate_networks() for [('9d6d93fc-f557-45a9-8e7c-c7d67b014366', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:38:46.167169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:46.168601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:46.176305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.177121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.177795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.178832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.179608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.181427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.366446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:46.380846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:46.382753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:46.384468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bac70153-5c37-467f-be5b-9c8202c741f7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.222843 Aug 23 22:38:46.399836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 395/810] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:46.405164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:46.405164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:46.412909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.413563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.413998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.414878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.415333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.415764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.623447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:46.654401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-944808ec-06a3-4554-9dfd-18e1eabb1b9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1750 microversion: 2.1 time: 0.255320 Aug 23 22:38:46.654401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 396/811] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1750 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:46.733668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:46.755236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.755711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.760732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.776055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] Creating event network-changed:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:38:46.782440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-20ed3c4c-fa25-4188-bf21-3287e836d7ad req-da8ce74a-e8af-4929-8b0c-8191184bd1b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052287 Aug 23 22:38:46.783440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 397/812] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:38:46.925681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:38:46.926304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:38:46.926706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:38:46.927280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:38:46.927682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:38:46.946340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.946948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.947457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.948279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:46.949877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:46.950589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:46.993366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:38:47.002158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Getting quotas for user 2ca578d6a1374212a4f1476335c641b3 and project 0430b3e5fcd0415fb2c658443d8f6bf1. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:38:47.026600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:38:47.028902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:38:47.212606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b5b36887-0714-4c28-8fa9-39bdd1123f73 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.866612 Aug 23 22:38:47.214077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 416/813] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 22:38:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:38:47.227267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9097975-89c0-4a03-8900-c456ee150622 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:47.228808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9097975-89c0-4a03-8900-c456ee150622 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:47.360484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9097975-89c0-4a03-8900-c456ee150622 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:47.360484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9097975-89c0-4a03-8900-c456ee150622 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1237 microversion: 2.1 time: 0.136792 Aug 23 22:38:47.373636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 398/814] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:47 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1237 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:47.407883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:47.408498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:47.422717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:47.423201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:47.423629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:47.424916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:47.425647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:47.425827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:47.676770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:47.677754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:47.686786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:47.687151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:47.687757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:47.688473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:47.688929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:47.689386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:47.845956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:47.857797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:47.859413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:47.860693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b87faad8-0a07-4869-a905-daf33a8a0fb9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.457105 Aug 23 22:38:47.861380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 417/815] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:47.865454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:47.876196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-521d090f-c34d-4e8d-88b9-92d3375fa8cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.204553 Aug 23 22:38:47.876934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 399/816] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:48.382880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3425e043-d6bd-4306-b855-b68c9f23e986 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:48.383983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3425e043-d6bd-4306-b855-b68c9f23e986 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:48.447865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3425e043-d6bd-4306-b855-b68c9f23e986 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:48.463716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3425e043-d6bd-4306-b855-b68c9f23e986 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1237 microversion: 2.1 time: 0.084957 Aug 23 22:38:48.464909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 418/817] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:48 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:48.860236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:48.871658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:48.873242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:48.873242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:48.887117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:48.887882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:48.896712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] Creating event network-changed:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:38:48.897921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:48.899534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:48.901674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:48.903392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-099ad2ad-8e84-499d-8ce5-35029e5392fe req-5dd5703b-c0f5-4568-9f14-e5611f204814 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046540 Aug 23 22:38:48.903900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:48.904821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:48.909760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 400/818] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:48.909894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:48.918208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:48.919161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:48.932025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:48.932953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:48.933585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:48.934558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:48.935019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:48.935639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:49.070236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:49.081380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:49.084398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:49.085905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f3907c92-0cc8-409e-889b-8bf1daf834d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.202805 Aug 23 22:38:49.086522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 419/819] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:49.203062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:49.212289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fd1c473a-b244-488f-8153-501846137f3e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.305118 Aug 23 22:38:49.212879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 401/820] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:49.484935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:49.485897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:49.493668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:49.494291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:49.494841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:49.495671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:49.496212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:49.496731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:49.570882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:49.578715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1657d4b8-6002-48af-880b-b505e8c7ad11 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1241 microversion: 2.1 time: 0.097673 Aug 23 22:38:49.579303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 420/821] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:49 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:50.111429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:50.112608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:50.119294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.122238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.122238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.122238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.122238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.122676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.235761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:50.237658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:50.243823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.244328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.244768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.245518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.245977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.246417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.256249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:50.264738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:50.266269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:50.267439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-888a2c23-e274-4455-9e44-5e00afed3e0c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1738 microversion: 2.20 time: 0.160308 Aug 23 22:38:50.268073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 402/822] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:50.391161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:50.399837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f22bd7ae-0769-4419-b284-da6c9b40f12f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.167898 Aug 23 22:38:50.400395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 421/823] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:50.600536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:50.601283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:50.607825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.608304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.608734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.609443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:50.609891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:50.610306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:50.675740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:50.684038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-de93f157-3a4a-479b-b7d2-ff08b28ec365 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1289 microversion: 2.1 time: 0.088122 Aug 23 22:38:50.684619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 403/824] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:50 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:51.291001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:51.291611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:51.298904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.300674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.301420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.302314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.302931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.303506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.423615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:51.425371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:51.432970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.433492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.434223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.434935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.435708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.436326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.566633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:51.576541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:51.578086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:51.579633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3331bb7b-a94c-4d1a-b13d-8251ba678965 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1720 microversion: 2.20 time: 0.292695 Aug 23 22:38:51.580480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 422/825] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:51 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:51.707191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:51.708066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:51.714784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.715451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.715894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.716680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:51.717109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:51.717533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:51.789932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:51.797699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a201f388-7bfd-46a6-866a-da773e30b6e5 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1295 microversion: 2.1 time: 0.095835 Aug 23 22:38:51.798270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 423/826] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:51 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:51.889294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:51.898493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-84285cb9-623e-4a57-8173-3cab17ad9649 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.478728 Aug 23 22:38:51.899068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 404/827] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:52.604589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:52.605176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:52.612532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.613206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.613688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.615086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.615567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.616005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.620514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:52.766763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:52.780400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:52.782018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:52.783835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-229bd278-6337-43cb-b775-96c37fabe4f4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1720 microversion: 2.20 time: 0.182801 Aug 23 22:38:52.783967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 424/828] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:52.805668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "name": "network-vif-unplugged", "status": "completed", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:52.816773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.817282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.817720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.819850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:52.820580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:52.826770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.827257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.827694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.828385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.828843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.829298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.834212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] Creating event network-vif-unplugged:5c6bb5ba-892a-4226-aaf9-01d9d08525ab for instance e4822c04-cfe2-4f63-b2db-42c5011791cc on hv-cinder-84254 Aug 23 22:38:52.839150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-ca1a7251-ca6c-49f3-9b4d-317ddd155319 req-f5dffba4-164c-4efb-9c9a-2e38787a9331 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037367 Aug 23 22:38:52.839753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 405/829] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:52.922061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:52.922775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:52.929841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.930335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.930971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.931840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:52.932460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:52.932884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:52.972324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:52.981611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78439721-d69b-4d65-bfd2-4594379496df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.166134 Aug 23 22:38:52.982599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 425/830] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:52 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:53.089603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:53.098822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fc52bea0-65d4-4aaa-92ac-1fa9ee5ba379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.180889 Aug 23 22:38:53.099404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 406/831] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:53.807913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:53.807913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:53.814427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:53.814941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:53.815377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:53.816143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:53.816598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:53.817062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:53.952760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:53.961448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:53.963053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:53.964169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9cc97721-19d7-4868-bc5a-bb0c18764c80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1720 microversion: 2.20 time: 0.161005 Aug 23 22:38:53.964738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 426/832] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:54.003658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:54.005224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:54.012114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:54.012696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:54.013286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:54.014059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:54.014609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:54.015287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:54.120516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:54.128817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:54.128817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:54.128817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:54.129564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:54.129697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:54.130684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:54.131111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:54.194566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:54.202264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c2c7505b-dddd-4efb-b750-001cd419c3df tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.202572 Aug 23 22:38:54.202841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 407/833] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:53 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:54.289751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:54.298056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-10528795-56ed-447b-9f0c-d9b5447b927a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.181848 Aug 23 22:38:54.298639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 427/834] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:54.570937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1a66ba-0f8a-44f0-8c11-b81be113a633", "tag": "967a3daf-2e2c-41f1-80b5-4cf510ba8964"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:54.580959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:54.582188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:54.583072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:54.594783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] Creating event network-changed:967a3daf-2e2c-41f1-80b5-4cf510ba8964 for instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 on hv-cinder-84254 Aug 23 22:38:54.599741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-9cc1e587-1fbc-40f2-879f-47a1b87f0a4c req-4e785373-3deb-47ee-85bd-00d7ee3c7e0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032722 Aug 23 22:38:54.600349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 408/835] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:38:54.990220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:54.991132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:54.999683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.000179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.000665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.001430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.001890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.002315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.147433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:55.155919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:55.157574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:55.158640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b5f6f989-214c-4776-a43d-fee99df058f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1663 microversion: 2.20 time: 0.174529 Aug 23 22:38:55.159202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 428/836] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:55.183953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "200ef7df-7141-4681-92ae-ce1b4bf58790"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:55.186855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:55.196363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.196363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.196363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.196363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.196920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.196920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.224673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:55.225315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:55.231690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.232170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.232792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.233503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.234186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.234605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.377382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:55.386034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-76af7b48-7068-46bc-a1d5-df3f845fcd1c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.165514 Aug 23 22:38:55.386628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 429/837] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:55 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:55.391303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:55.392063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:55.406624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.407237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.407683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.408391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.408872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.409355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.557819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:55.566314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-44b687e8-d500-4781-85e1-98e98a2d3815 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.178662 Aug 23 22:38:55.566871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 430/838] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:56.408036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:56.408654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:56.415341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.415864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.421775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.421775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.421775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.421775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.527773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:56.554496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:56.562285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3b6954e5-bf32-472c-ba05-a579f36b5a7b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.158180 Aug 23 22:38:56.562847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 431/839] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:56 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:56.591226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:56.591922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:56.600076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.600673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.601275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.602192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.602603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.603098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.655088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-549f6e69-37e2-4e1e-9318-dc44e32ebdc4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.475919 Aug 23 22:38:56.655885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 409/840] 10.222.0.73 () {62 vars in 1364 bytes} [Tue Aug 23 22:38:55 2022] POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments => generated 188 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:38:56.761985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:56.771291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b27d54be-9f8a-4d86-aee8-f83d6ebfcbba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.184474 Aug 23 22:38:56.771637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 432/841] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:56.804888 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:56.805515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:56.812290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.812963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.813453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.814155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.814615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.815059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.864008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121885) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 22:38:57.207960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b6bb45a1-ba1d-4911-99b5-808ce78c22c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/action" status: 202 len: 0 microversion: 2.20 time: 0.406193 Aug 23 22:38:57.208648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 410/842] 10.222.0.73 () {62 vars in 1319 bytes} [Tue Aug 23 22:38:56 2022] POST /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:38:57.225817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:57.226433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:57.228290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:57.233410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.233907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.234346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.235052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.235509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.235934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.369874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.383064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.384736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.386305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b47ee0ec-63a7-4cf7-8443-d7d597c68ad7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1749 microversion: 2.20 time: 0.164888 Aug 23 22:38:57.392461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 433/843] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:57.584781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:57.589630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:57.590365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:57.597506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.598209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.598731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.599578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.600157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.600622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.741347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.749610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-50f54a6e-dd08-4899-9083-90f30e746172 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.165642 Aug 23 22:38:57.750510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 411/844] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:57 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:57.792462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:57.793113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:57.799775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.800261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.800774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.801512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:57.801962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:57.802384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.986344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.996113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd65540e-3e1f-4a93-bbfd-c03ca4267865 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.208275 Aug 23 22:38:58.002935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 434/845] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:58.410733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:58.411410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:58.418021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.418510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.418975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.419673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.420126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.420549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.554276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:58.563691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:58.566051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:58.568518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9afb1ab5-a56a-411e-acc5-e916de731211 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1749 microversion: 2.20 time: 0.162395 Aug 23 22:38:58.569900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 412/846] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:58.774111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:58.775113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:58.777405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=8 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:58.782937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.783504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.784014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.784863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.786360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.786955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.942002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:58.952010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e62a8ee-46b5-41db-a683-1ba37753089c tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.183188 Aug 23 22:38:58.960141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 435/847] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:58 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:59.018639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:59.019250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:59.025986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.026537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.027014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.027796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.028176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.028610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.219488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:59.229362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7e21a39-9626-494b-9bdf-255e65c97927 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1755 microversion: 2.1 time: 0.214542 Aug 23 22:38:59.230008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 413/848] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:38:59.594651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:59.595334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:59.601571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.602062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.602514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.603212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.603757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.604181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.773762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:59.783728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:59.785860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:59.787673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-50b0ea7d-4c4f-42a2-acf6-dad705cb9146 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.197001 Aug 23 22:38:59.788617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 436/849] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:38:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:38:59.973535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:59.974185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:59.983073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.983918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.984545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.985464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.986172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.986737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.135123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:00.143252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fbcc3a8a-8105-4e5c-9e07-47d730afdefe tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.174444 Aug 23 22:39:00.143883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 414/850] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:59 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:00.252413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:00.253419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:00.260712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.261266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.261721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.262405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.262846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.263269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.413542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:00.422114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d83f5690-e4b4-4388-a6b5-c0333c998bed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1758 microversion: 2.1 time: 0.174885 Aug 23 22:39:00.422682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 437/851] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:00.812221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:00.812830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:00.819201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.819674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.820101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.820773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.821244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.821656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.960421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:00.969386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:00.970899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:00.972061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ee8e5ddf-a105-4a9a-bee7-07438f543a85 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.163995 Aug 23 22:39:00.972649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 415/852] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:01.161389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1a66ba-0f8a-44f0-8c11-b81be113a633", "name": "network-vif-plugged", "status": "completed", "tag": "967a3daf-2e2c-41f1-80b5-4cf510ba8964"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:39:01.165791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:01.166700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:01.171485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:01.172056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:01.172520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:01.172930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:01.173456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:01.173905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:01.174570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:01.175018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:01.175572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:01.184979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] Creating event network-vif-plugged:967a3daf-2e2c-41f1-80b5-4cf510ba8964 for instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 on hv-cinder-84254 Aug 23 22:39:01.190114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-d0ff9fb8-2297-4f3e-af95-e16b13c40308 req-029f6e22-3cee-4c65-84bd-82bb1ae6ea2f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032943 Aug 23 22:39:01.190884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 438/853] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:39:01.315097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:01.323222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f69ffcb-9dd0-4b36-b2bc-affddd2312c7 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.162410 Aug 23 22:39:01.323792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 416/854] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:01 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:01.995751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:01.996552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:02.002884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:02.003373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:02.003805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:02.004496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:02.005543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:02.006014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:02.142260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:02.151938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:02.153504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:02.154836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d6cb6fa2-8a7a-471e-9335-cb3983472866 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.163929 Aug 23 22:39:02.155442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 439/855] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:02.343769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:02.344397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:02.350799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:02.351274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:02.355639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:02.355639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:02.355639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:02.355639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:02.484770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:02.493527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b56bbddb-c7da-4bfe-af71-db1488c36205 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.153640 Aug 23 22:39:02.494093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 417/856] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:02 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:03.178114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:03.178764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:03.185573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:03.186053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:03.186483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:03.187162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:03.187606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:03.188017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:03.322271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:03.335053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:03.336611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:03.343643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f8471def-2cef-4f43-84be-68bf5fa86524 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164572 Aug 23 22:39:03.343643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 440/857] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:03.515033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:03.515781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:03.523221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:03.523714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:03.524153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:03.524852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:03.525374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:03.525799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:03.657064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:03.664801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d108e4cd-ed5a-457d-ade1-8f3a578f786f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1363 microversion: 2.1 time: 0.153634 Aug 23 22:39:03.665396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 418/858] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:03 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:04.363498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:04.365268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:04.371976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.372466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.372909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.373636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.374093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.374717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.393262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:04.510548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:04.519395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:04.520909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:04.522107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-47f91b16-61a8-48ca-a4c8-8724b5b5314a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164067 Aug 23 22:39:04.522671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 441/859] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:04.685634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:04.686189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:04.693396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.693986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.694563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.695530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.696050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.696576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.834073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:04.841965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a49b442-ab51-40ab-ab98-ec7e4d69d145 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1548 microversion: 2.1 time: 0.160404 Aug 23 22:39:04.842537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 419/860] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:04 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:04.863241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:04.863737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:04.870155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.881431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.881431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.881431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:04.881431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:04.881827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:04.951249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-59ee4c15-b0e8-4186-bb94-70f5b22c63de tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091898 Aug 23 22:39:04.951841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 442/861] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 22:39:04 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:39:05.545847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:05.546437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:05.553099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:05.553594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:05.554023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:05.554720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:05.555166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:05.555579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:05.689709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:05.700030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:05.701591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:05.702754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ad712706-5194-43f7-a2d9-ed091c9277bc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.161006 Aug 23 22:39:05.703447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 420/862] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:06.011261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1a66ba-0f8a-44f0-8c11-b81be113a633", "tag": "967a3daf-2e2c-41f1-80b5-4cf510ba8964"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:39:06.021281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:06.021838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:06.022334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:06.037098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] Creating event network-changed:967a3daf-2e2c-41f1-80b5-4cf510ba8964 for instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 on hv-cinder-84254 Aug 23 22:39:06.042593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-1a26bb78-84c7-4ece-bba1-c1812876fb23 req-505708a7-b915-4be4-a9b0-85d2167686ef service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036453 Aug 23 22:39:06.043515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 443/863] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:39:06.727061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:06.728311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:06.734838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:06.739653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:06.739653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:06.739653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:06.739653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:06.740030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:06.887678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:06.897070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:06.898577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:06.899746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6f217129-901e-4141-9d6f-062b4d557c1b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.176850 Aug 23 22:39:06.900304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 421/864] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:07.923752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:07.924453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:07.930971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:07.931481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:07.931934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:07.932639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:07.933116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:07.933543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:08.064869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:08.074992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:08.076547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:08.077796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5c0a5fed-db7b-4064-8be0-e31b194d4dec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159034 Aug 23 22:39:08.078341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 444/865] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:09.102951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:09.103593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:09.105982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:09.110723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:09.111199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:09.111630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:09.112308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:09.112756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:09.113199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:09.246634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:09.255721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:09.257293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:09.258467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b67d3d65-52f3-4e34-9d2f-8f2f88fc682a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160149 Aug 23 22:39:09.259021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 422/866] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:10.281695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:10.282304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:10.289172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:10.289665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:10.290105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:10.290933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:10.291395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:10.291820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:10.431128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:10.440234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:10.441800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:10.443798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9a4c22ea-94be-4ace-ad1a-5eaf8bdad10f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166240 Aug 23 22:39:10.444366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 445/867] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:11.468648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:11.469332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:11.477038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:11.477524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:11.478002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:11.478699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:11.479196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:11.479623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:11.613126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:11.622125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:11.623645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:11.624822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d6d457a1-a3ec-4bbd-9793-f7e5de3ca4b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160463 Aug 23 22:39:11.625402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 423/868] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:12.647545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:12.648147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:12.650627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:12.655441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:12.655928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:12.656356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:12.657062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:12.657514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:12.657933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:12.789960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:12.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:12.799978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:12.801219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7adc7f4-97bd-4a2f-be68-52e30f76bf12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157448 Aug 23 22:39:12.802347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 446/869] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:13.826024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:13.826587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:13.833671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:13.834192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:13.834648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:13.835395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:13.835895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:13.836343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:13.967567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:13.971044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:13.977113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:13.978696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:13.981417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ac060989-826a-41f6-bb98-b9e047996f5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.158025 Aug 23 22:39:13.981417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 424/870] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:15.004027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:15.004655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:15.012134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:15.012651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:15.013117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:15.013821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:15.014275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:15.014782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:15.152456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:15.161984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:15.176338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:15.176338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c4d8b445-1b62-4057-988a-5afac0a23706 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164736 Aug 23 22:39:15.176338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 447/871] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:16.188906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:16.189703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:16.198350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:16.198847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:16.199321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:16.200025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:16.200618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:16.201283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:16.335409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:16.343557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:16.345536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:16.346694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3476b84d-edab-49d3-9e48-58da77bc35b1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162252 Aug 23 22:39:16.347256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 425/872] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:17.369749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:17.370365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:17.376727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:17.377258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:17.377699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:17.378393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:17.378849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:17.379302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:17.512370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:17.521848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:17.523399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:17.524542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7dc905f8-a879-496f-9c31-6c21381a579a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.158746 Aug 23 22:39:17.525129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 448/873] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:18.548162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:18.548762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:18.555998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:18.556497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:18.556960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:18.557684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:18.558150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:18.558859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:18.694698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:18.703421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:18.704916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:18.706121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d51df156-0b57-4ba4-b5ab-324c5aab1006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162058 Aug 23 22:39:18.706930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 426/874] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:19.730902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:19.731538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:19.738269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:19.738753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:19.739602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:19.740323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:19.740777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:19.741238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:19.875177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:19.884754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:19.886312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:19.887467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07a3c3bc-cea1-47b7-953b-17f76c26edc5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160515 Aug 23 22:39:19.888238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 449/875] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:20.911045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:20.912003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:20.921747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:20.922569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:20.923251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:20.924220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:20.924892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:20.925575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:21.059053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:21.067581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:21.070022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:21.071583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-340497be-26d9-44af-a4c9-91847bb4204e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164390 Aug 23 22:39:21.071922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 427/876] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:22.094405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:22.095107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:22.102691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:22.103184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:22.103621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:22.104371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:22.104840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:22.105297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:22.243686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:22.252405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:22.253919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:22.255053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2f932687-db70-4ec9-90ef-6889317a4506 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164819 Aug 23 22:39:22.255601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 450/877] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:23.280488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:23.281192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:23.288401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:23.288855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:23.289319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:23.290013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:23.290468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:23.290899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:23.420544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:23.429542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:23.431042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:23.432182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-479e2236-00dd-40cf-a518-b236d66428aa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.155708 Aug 23 22:39:23.432737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 428/878] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:24.465252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:24.465871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:24.472099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:24.472571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:24.472997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:24.473690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:24.474134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:24.474577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:24.606191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:24.615758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:24.617531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:24.618733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bc370914-bf9c-4dad-a1a9-af578c970b06 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157399 Aug 23 22:39:24.619314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 451/879] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:25.644555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:25.645299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:25.652066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:25.652551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:25.652987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:25.655534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:25.655534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:25.655534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:25.797572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:25.807036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:25.808576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:25.809737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2638535d-5b9c-432d-b883-220f5460fc5f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.169416 Aug 23 22:39:25.810299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 429/880] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:26.832922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:26.833556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:26.840635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:26.841159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:26.849108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:26.849108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:26.849108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:26.849108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:26.982246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:26.992266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:26.996013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:26.996013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-348cc9bd-bfd5-4a14-af78-e7693fd77eef tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166482 Aug 23 22:39:26.996013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 452/881] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:28.019434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:28.020038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:28.027482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:28.027966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:28.028403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:28.029209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:28.029661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:28.030088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:28.165764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:28.174698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:28.176205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:28.177544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fce2e295-664a-42a8-8cdd-8885a1230a92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162030 Aug 23 22:39:28.178247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 430/882] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:29.202692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:29.203283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:29.210520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:29.210996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:29.211422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:29.212100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:29.212539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:29.212950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:29.354822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:29.365617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:29.367421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:29.368453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ed98910c-f221-4e61-a5a8-e697a04a3cc9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.169648 Aug 23 22:39:29.369000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 453/883] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:30.391848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:30.392464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:30.399837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:30.400325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:30.400754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:30.401471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:30.401916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:30.402331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:30.564625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:30.580207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:30.581994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:30.583407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5623add1-0430-46ab-8fe2-952860621f26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.195586 Aug 23 22:39:30.584522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 431/884] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:31.607713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:31.608353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:31.614520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:31.615752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:31.616244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:31.616932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:31.617415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:31.617838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:31.753894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:31.763032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:31.764531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:31.765835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7436b277-1646-4722-83cc-4d1e9e1c0507 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.161879 Aug 23 22:39:31.766403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 454/885] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:32.790442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:32.791061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:32.798242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:32.798733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:32.799174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:32.799968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:32.800428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:32.801039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:32.939494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:32.949085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:32.950770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:32.952052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1e28965-330f-4d81-8cfd-64ba56f2f8f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166349 Aug 23 22:39:32.952680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 432/886] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:33.188006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:39:33.188591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:39:33.975740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:33.976390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:33.983280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:33.983814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:33.984295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:33.984993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:33.985480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:33.985904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:34.128435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:34.138532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:34.140040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:34.141264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0ec7f936-23b4-4f64-961d-6e1cbc281010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.169744 Aug 23 22:39:34.141983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 455/887] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:35.165915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:35.166517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:35.173122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:35.173601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:35.174031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:35.174741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:35.175344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:35.175706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:35.312674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:35.321985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:35.323497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:35.325635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e8b1cedd-a93c-4a58-bfa6-d8552a95425e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162711 Aug 23 22:39:35.325635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 433/888] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:36.348035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:36.348724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:36.355923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:36.356436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:36.356914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:36.357636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:36.358134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:36.358615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:36.361387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=81 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:36.494793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:36.503897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:36.505589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:36.506837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-afed7700-04c5-436c-bece-fd887c991cd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162860 Aug 23 22:39:36.507399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 456/889] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:37.530606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:37.531205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:37.537635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:37.538115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:37.538543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:37.539729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:37.540211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:37.540603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:37.847341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:37.857332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:37.858844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:37.860007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5cbdc4dd-d67e-41c1-8b48-043041e02ce0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.333342 Aug 23 22:39:37.860599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 434/890] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:38.884637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:38.885274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:38.891989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:38.892480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:38.892916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:38.893649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:38.894101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:38.894528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:39.032727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:39.042436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:39.044023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:39.045254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-719b5fde-daa6-450c-8634-a31d5cbd7fed tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.165511 Aug 23 22:39:39.045814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 457/891] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:40.068410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:40.069090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:40.075667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:40.076164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:40.076599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:40.077338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:40.077795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:40.078224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:40.217969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:40.227925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:40.229480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:40.230660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-383558fc-b483-4647-8ce4-dfcc8e685340 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166254 Aug 23 22:39:40.231207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 435/892] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:40 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:41.253114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:41.253732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:41.261522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:41.262014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:41.262451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:41.263173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:41.263623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:41.264044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:41.407995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:41.417832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:41.419338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:41.420544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-77a983c7-0701-4ae5-ae7c-4210001c0d83 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.171350 Aug 23 22:39:41.421300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 458/893] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:42.444193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:42.444762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:42.447972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=28 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:42.453136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:42.453634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:42.454073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:42.454780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:42.455236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:42.455919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:42.597281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:42.606916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:42.608459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:42.609763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-143818ed-8f74-4ba7-a4ed-4e8ee1572e46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.169757 Aug 23 22:39:42.610674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 436/894] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:43.633933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:43.634539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:43.639297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=26 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:43.644967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:43.644967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:43.644967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:43.644967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:43.659309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:43.659309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:43.807435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:43.817143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:43.818548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:43.819737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cd650ad8-1292-4646-a994-2a8c8036a9b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.189703 Aug 23 22:39:43.820710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 459/895] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:44.843789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:44.844403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:44.851653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:44.856754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:44.856754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:44.856754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:44.856754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:44.857280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:44.993853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:45.003216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:45.004795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:45.006126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f6b58479-ffb4-4e87-9049-844d4bf2b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166656 Aug 23 22:39:45.006691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 437/896] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:46.030006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:46.030695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:46.039689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:46.040177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:46.040605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:46.041341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:46.041782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:46.042202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:46.183910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:46.193388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:46.194902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:46.196200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2aae901f-f227-411e-8c6d-5eac6199ef04 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.170165 Aug 23 22:39:46.196766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 460/897] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:47.219795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:47.220405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:47.226793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:47.227811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:47.228246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:47.228947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:47.229425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:47.229926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:47.232683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=79 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:47.364018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:47.373438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:47.374976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:47.376163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f2095abf-84cd-4428-827e-62554950bfc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160310 Aug 23 22:39:47.376776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 438/898] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:48.401423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:48.402192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:48.408861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:48.409377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:48.409890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:48.410583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:48.411038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:48.411460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:48.550840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:48.561554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:48.563183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:48.564396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3ac05d5-5458-46e7-a5b8-dc75b22da298 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.168177 Aug 23 22:39:48.564990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 461/899] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:49.590128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:49.590732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:49.597286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:49.597786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:49.598218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:49.598910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:49.599360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:49.599779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:49.757302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:49.767109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:49.768617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:49.769810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7da6e14-0c52-4d52-a9be-3580c83f8bf2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.184331 Aug 23 22:39:49.770420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 439/900] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:50.794040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:50.794987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:50.801498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:50.801991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:50.802432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:50.803181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:50.803633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:50.804057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:51.190924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:51.202256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:51.203856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:51.205510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-28672635-cac4-4ba3-b41a-f13db5df63ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.415519 Aug 23 22:39:51.206118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 462/901] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:52.229465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:52.230055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:52.236486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:52.236967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:52.237428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:52.238117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:52.238566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:52.238988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:52.373640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:52.382812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:52.384349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:52.386154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6626f7e3-ff11-4e56-be6c-2d5ea6eac6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160718 Aug 23 22:39:52.386915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 440/902] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:53.409052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:53.409745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:53.416279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:53.416853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:53.417484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:53.418183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:53.418639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:53.419068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:53.547516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:53.556505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:53.558863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:53.560035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c326630-aa8a-41ac-bf0d-dfc42170372e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.154948 Aug 23 22:39:53.560590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 463/903] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:54.584064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:54.584805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:54.593450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:54.594068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:54.594581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:54.595406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:54.595900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:54.596444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:54.739336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:54.748030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:54.749725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:54.750878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-72526ee7-201c-42f5-9af8-dbb6c1d79a90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.171885 Aug 23 22:39:54.751420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 441/904] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:55.774172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:55.774879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:55.781688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:55.783232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:55.783660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:55.784360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:55.784816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:55.785268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:55.932844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:55.945537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:55.947199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:55.948542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f25f784-fa96-406e-892d-f6bfc9e45d72 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.178252 Aug 23 22:39:55.949213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 464/905] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:39:56.976164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:56.976761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:56.984209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:56.984808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:56.985279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:56.985977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:56.986431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:56.986854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:57.120163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:57.129809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:57.131355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:57.132523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ea930af9-d800-4c78-b03d-0baa006e921d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160251 Aug 23 22:39:57.133092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 442/906] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:58.155775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:58.156422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:58.163150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:58.163628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:58.164059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:58.164746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:58.165255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:58.165633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:58.299309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:58.308103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:58.309637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:58.310788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7d3132d4-b856-42d6-a79f-ce3385313d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159340 Aug 23 22:39:58.311344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 465/907] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:39:59.335014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:59.335674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:59.341883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:59.342366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:59.342802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:59.343525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:59.343997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:59.344411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:59.480007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:59.489950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:59.491456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:39:59.492626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c30d536e-dd34-40ee-836a-af6fdcf0cbaa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162409 Aug 23 22:39:59.493203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 443/908] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:39:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:00.516603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:00.517388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:00.523810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:00.524301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:00.524742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:00.525467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:00.525919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:00.526336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:00.666677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:00.677185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:00.678700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:00.679910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31e8abf8-299b-437b-8289-efce0ed76f02 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.167936 Aug 23 22:40:00.680601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 466/909] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:00.985192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:00.985799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:00.993136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:00.993744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:00.994183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:00.994883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:00.995334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:00.995756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:01.079252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'services' on Instance uuid 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:40:01.321938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-97744c8e-6103-432d-900b-a2a27ee8eb22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments/10ca7eed-de9c-44d5-9c99-7b1df6b28a9c" status: 202 len: 0 microversion: 2.1 time: 0.340474 Aug 23 22:40:01.322770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 444/910] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:40:00 2022] DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments/10ca7eed-de9c-44d5-9c99-7b1df6b28a9c => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:40:01.342459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:01.344645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:01.351816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:01.352598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:01.353235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:01.354210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:01.354784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:01.355364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:01.387507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1832ddf8-3f59-4935-84d6-c89ecfb7313b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059970 Aug 23 22:40:01.388032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 467/911] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:01.707746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:01.708475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:01.714867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:01.715355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:01.715853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:01.716629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:01.716942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:01.717492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:01.857275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:01.867128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:01.868693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:01.869879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9e5d9c1-6afa-4067-b282-e8fa7e915824 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.167027 Aug 23 22:40:01.870424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 445/912] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:02.400568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:02.402731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:02.409893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:02.410376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:02.410840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:02.411527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:02.411979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:02.412394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:02.441372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-80598656-7c92-4d0a-81a7-75033b1123fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 23 22:40:02.441934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 468/913] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:02.893727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:02.894267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:02.900855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:02.901429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:02.901930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:02.902697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:02.903199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:02.903678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:03.048478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:03.057428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:03.058891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:03.060044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e092380-588e-42eb-a51f-957a121a6df2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.170980 Aug 23 22:40:03.060594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 446/914] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:03.453992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:03.456411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:03.462935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:03.463428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:03.463864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:03.464558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:03.465044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:03.465458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:03.495974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3609efc1-42d6-47a9-9782-c5e5f5543f29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Aug 23 22:40:03.496534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 469/915] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:04.087548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:04.088191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:04.095213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:04.095736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:04.096175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:04.096870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:04.097359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:04.097786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:04.229169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:04.241579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:04.243596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:04.245469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-36c1377f-dd4e-4661-bcad-8ef97e7cb6a4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.161639 Aug 23 22:40:04.246141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 447/916] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:04.510654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:04.512852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:04.519784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:04.520311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:04.520753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:04.521490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:04.521941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:04.522367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:04.552042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0011df29-1eab-422e-bc0b-b59552fcc655 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Aug 23 22:40:04.552663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 470/917] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:05.270790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:05.271389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:05.277853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:05.278331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:05.278762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:05.279445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:05.279903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:05.280317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:05.414457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:05.424335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:05.425893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:05.427144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-184148ba-77da-4a7d-b5bf-ce1780ccdd76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160259 Aug 23 22:40:05.427695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 448/918] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:05.565247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:05.567398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:05.573994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:05.574462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:05.574894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:05.575576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:05.576122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:05.576551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:05.607348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-612e2728-c62b-477d-af91-19de6967d300 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Aug 23 22:40:05.607911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 471/919] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:06.452453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:06.453151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:06.459722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:06.460205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:06.460637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:06.461348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:06.461836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:06.462247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:06.600001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:06.612511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:06.612511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:06.613392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4a5e0405-3273-4e32-80c0-5c50978df91a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164794 Aug 23 22:40:06.614123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 449/920] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:06.619936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:06.622093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:06.629174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:06.629661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:06.630097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:06.630865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:06.631316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:06.631736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:06.634287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=96 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:06.664948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dbfcc636-41c3-447f-8a91-e179ba51a61c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049000 Aug 23 22:40:06.665557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 472/921] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:07.639356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:07.640023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:07.646878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:07.647364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:07.647839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:07.648528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:07.648985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:07.649434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:07.678044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:07.680178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:07.686885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:07.687364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:07.688416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:07.689246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:07.689720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:07.690315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:07.719929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d0f17162-f929-410a-9e7e-a38de2ca5967 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Aug 23 22:40:07.720498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 473/922] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:07.785640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:07.796163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:07.798867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:07.804498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-83f66535-e118-4e94-95ca-092f83eac7b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164655 Aug 23 22:40:07.804498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 450/923] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:08.732010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:08.734183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:08.741334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:08.741846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:08.742287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:08.742979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:08.743453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:08.743860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:08.773856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5c8ed918-10f0-4f36-94d4-2088ea6397bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Aug 23 22:40:08.774436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 474/924] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:08.823619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:08.824304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:08.832117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:08.832609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:08.833130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:08.833822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:08.834279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:08.834757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:08.974941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:09.011867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:09.011867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:09.011867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b70d01f6-7a66-4518-bd83-cf861a82a5ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.167631 Aug 23 22:40:09.012328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 451/925] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:09.787465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:09.789644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:09.796268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:09.797262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:09.797734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:09.798462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:09.798919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:09.799348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:09.832276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2d3ac895-41e5-4deb-b021-12617609ea14 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049396 Aug 23 22:40:09.832840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 475/926] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:10.011853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:10.012534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:10.019551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:10.020031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:10.020459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:10.021192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:10.022250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:10.022831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:10.162203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:10.170941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:10.173138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:10.174294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-861c087f-a095-49f9-b4ab-5396476c5482 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.166568 Aug 23 22:40:10.174841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 452/927] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:10.845713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:10.847777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:10.854273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:10.854757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:10.855192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:10.855881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:10.856337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:10.856765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:10.886408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3adb4c7d-0f3a-4754-ad57-ad0f82ca622f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Aug 23 22:40:10.886970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 476/928] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:11.197607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:11.198238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:11.205144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:11.205623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:11.206051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:11.206736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:11.207184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:11.207594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:11.341313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:11.351363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:11.353226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:11.354398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7e569731-9a1d-4729-a014-968f1d2f8de9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160716 Aug 23 22:40:11.354953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 453/929] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:11.899528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:11.901755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:11.909915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:11.910591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:11.910911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:11.911622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:11.912178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:11.912620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:11.944719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2fc5f447-221b-41ba-b5b0-c3794e1dd4e2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Aug 23 22:40:11.945310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 477/930] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:12.379356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:12.379996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:12.386386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:12.386868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:12.387302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:12.387989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:12.388445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:12.388859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:12.392334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:12.522971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:12.532064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:12.533598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:12.534742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1a2b1c8-3f04-4306-b456-4942f4ad7759 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159967 Aug 23 22:40:12.535293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 454/931] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:12.956977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:12.959219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:12.965648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:12.966138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:12.966581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:12.967275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:12.967751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:12.968175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:12.997428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4965560d-4744-443f-bf3a-cc542e70a810 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Aug 23 22:40:12.997987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 478/932] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:13.558200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:13.558886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:13.560622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=38 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:13.566028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:13.566532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:13.566962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:13.567653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:13.568096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:13.568545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:13.708997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:13.717814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:13.720624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:13.722940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fb00cb5b-be52-43a2-911b-42e031caa678 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.168965 Aug 23 22:40:13.723887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 455/933] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:14.010419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:14.012575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:14.014911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=40 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:14.019581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:14.020064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:14.020495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:14.021217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:14.027505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:14.027505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:14.055105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7ff03b7b-93a0-4814-8c44-5df87a185d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048568 Aug 23 22:40:14.055674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 479/934] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:14.747351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:14.747974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:14.755047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:14.755513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:14.755980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:14.756712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:14.757230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:14.765448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:14.898074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:14.908103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:14.911333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:14.911333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-73b69a63-b74a-4591-96aa-37586d7d3f2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.167455 Aug 23 22:40:14.911333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 456/935] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:15.069614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:15.071892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:15.079154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:15.079684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:15.080083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:15.080785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:15.081264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:15.081722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:15.116354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0998c930-fefb-4190-8078-9c30161edc11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047816 Aug 23 22:40:15.116354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 480/936] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:15.935455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:15.936092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:15.943319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:15.943803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:15.944237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:15.944928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:15.945405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:15.945825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:16.080606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:16.089793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:16.091308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:16.092516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8e4c054c-38d5-4bc3-b712-6c17cd4989c9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.161289 Aug 23 22:40:16.093784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 457/937] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:16.127529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:16.129798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:16.137424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:16.138113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:16.138707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:16.139541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:16.140089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:16.141227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:16.177598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d05288e8-2b45-45d7-93d9-ee7d7f7e3241 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054691 Aug 23 22:40:16.178298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 481/938] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:17.117822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:17.118611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:17.125268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.125883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.126319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.127016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.127469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.127890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.191886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:17.194870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:17.202707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.204286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.204915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.205764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.206271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.206776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.244916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8e3903b2-3c4d-4b0b-925e-dcc1d06cd026 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057892 Aug 23 22:40:17.245555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 482/939] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:17.251188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-368752948"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:40:17.251772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:17.258214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.258698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.259150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.260095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.260878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.261362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.287849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:17.297320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:17.299177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:17.300351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cd267fee-2a51-413b-8fa1-e4c096151c97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.186623 Aug 23 22:40:17.300923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 458/940] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:17.399990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.network.security_group_api [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Removing security group f2a0baba-c142-431e-bb47-e4f89cc560ec from port 85c5326d-185d-4f64-b484-2d2f97361b40 Aug 23 22:40:17.787625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c9fb40d9-8939-4d5a-a880-09a6a053e53f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action" status: 202 len: 0 microversion: 2.1 time: 0.541128 Aug 23 22:40:17.788301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 483/941] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:40:17 2022] POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:40:17.797805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:40:17.808157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:17.808661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:17.810264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:17.828103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] Creating event network-changed:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:40:17.834312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-1f6cb05c-6764-4a7c-a718-091047adf5ab req-752dd3ec-0ec7-491b-9cb4-f482cb8a4600 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040615 Aug 23 22:40:17.835409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 459/942] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:18.262755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:18.266390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:18.277844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:18.278714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:18.279483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:18.285509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:18.288179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:18.288929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:18.325063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:18.326619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:18.336606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:18.337281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:18.337977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:18.338280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-efaa68b1-8b79-4dc1-b91f-de2ca5840642 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082629 Aug 23 22:40:18.338938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:18.339691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:18.340352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:18.340893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 484/943] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:18.823654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:18.835775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:18.837749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:18.839669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-737a2882-c8bc-4a48-808b-6fafeee10d90 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.519393 Aug 23 22:40:18.840495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 460/944] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:19.292467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:19.293758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:19.302171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.302731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.303195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.304036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.304559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.305040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.356822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:19.360300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:19.370029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.370797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.371794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.372988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.373659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.374525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.433092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1f44687f-c9b8-4ff3-afbb-d297daa62d73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079947 Aug 23 22:40:19.434222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 461/945] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:19.463645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lazy-loading 'services' on Instance uuid 2cec364e-1e66-4f45-a083-ea4e54b53913 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:40:19.851905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:40:19.862141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.862621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.863052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.878769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] Creating event network-changed:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 22:40:19.883839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-241614f5-64fa-49d1-9a13-2749bf4b05a3 req-d08d12f4-532a-4c34-aa27-cbd63585ff47 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035920 Aug 23 22:40:19.884700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 462/946] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:19.889702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:19.895097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:19.897366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.897826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.898270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.898974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.899430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.899852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.922363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ddf2dd48-daa3-48ba-a2f8-21cef03d83c2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments/4941c8d3-f0b7-414b-a921-ab428f21bfd8" status: 202 len: 0 microversion: 2.1 time: 0.634969 Aug 23 22:40:19.923361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 485/947] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:40:19 2022] DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments/4941c8d3-f0b7-414b-a921-ab428f21bfd8 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:40:19.934634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:19.938895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:19.948346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.949271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.950111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.951120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:19.951659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:19.952229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:19.988121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9899e586-6f36-4fa1-b295-12ca06414055 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058300 Aug 23 22:40:19.995168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 486/948] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:20.221593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:20.237775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:20.240417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:20.241747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1a07f8d-256f-4506-850b-c09e1cd1f740 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.356166 Aug 23 22:40:20.242598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 463/949] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:20.451041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:20.457987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:20.465390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:20.466345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:20.466970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:20.468614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:20.469127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:20.469559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:20.515689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ab0aab4f-e6d4-47b9-8185-f6e238a38e0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069431 Aug 23 22:40:20.516272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 487/950] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:21.005941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:21.009153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:21.019183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.019909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.020561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.021654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.022330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.022978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.067287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1128be32-d921-4f6e-9026-bcf7a60fd1c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068012 Aug 23 22:40:21.068105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 464/951] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:21.271207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:21.271809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:21.277996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.278475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.278908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.279596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.280048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.280466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.297070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:21.419579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:21.428769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:21.430300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:21.431455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4ce091a5-18c3-4ea6-8b60-25a0cd38719e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164293 Aug 23 22:40:21.432001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 488/952] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:21.528876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:21.531682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:21.537798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.538282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.538708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.539392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:21.540021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:21.540247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:21.570285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ade24ced-eef0-45ad-93db-94c3edf004d9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Aug 23 22:40:21.570836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 465/953] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:22.081290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:22.083517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:22.089957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.090438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.090879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.091565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.092016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.092430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.122973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5584a71c-6a57-417c-a3fe-8ad89cd96026 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Aug 23 22:40:22.123519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 489/954] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:22.455059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:22.455724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:22.462064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.462548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.463008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.463701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.464151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.464568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.587685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:22.591391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:22.602314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.603192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.603974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.605164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:22.606002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:22.606772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:22.619926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:22.629919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:22.631336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:22.632547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ef40704-2a40-42f1-bf68-fc3a76245b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.181988 Aug 23 22:40:22.633121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 466/955] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:22.656883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a0657dc-b085-46b7-ab6b-5cf8d33d9f33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075770 Aug 23 22:40:22.657945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 490/956] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:23.135560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:23.137796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:23.144672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.145200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.145627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.146316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.146768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.147187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.177651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-90d99482-3fdc-45a8-924d-47c41626e308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Aug 23 22:40:23.178118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 467/957] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:23.672112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:23.673395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:23.676487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:23.678731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:23.682747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.683240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.683673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.684380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.684836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.685276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.687819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.688569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.689042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.689790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:23.690279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:23.690664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:23.722974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dfd09935-37b7-4a30-8196-5046e762b273 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050374 Aug 23 22:40:23.723552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 468/958] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:23.828760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:23.837783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:23.839392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:23.840580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-393ceea7-1c2f-4ea9-ae58-52aefbd1d8cc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.173259 Aug 23 22:40:23.841155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 491/959] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:24.190778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:24.192879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:24.198867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.199356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.199795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:24.200491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.200945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.201400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:24.232114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f2079edd-c886-4231-8fcf-bf509e9e71f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Aug 23 22:40:24.232677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 469/960] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:24.735777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:24.737948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:24.744404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.744885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.745364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:24.746052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.746501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.746920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:24.778231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9567f123-a8aa-462d-a094-ff58943cde02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Aug 23 22:40:24.778793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 492/961] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:24.863213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:24.863891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:24.870385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.870852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.871367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:24.872088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:24.872546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:24.872984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:25.010174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:25.019628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:25.021339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:25.022828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c85cc33c-6364-4956-a6ba-0f286d8cddd3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.163437 Aug 23 22:40:25.023645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 470/962] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:25.244403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:25.246533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:25.252662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:25.253166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:25.253593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:25.254269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:25.254711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:25.255122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:25.285198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-96e69141-f908-4ada-87db-b5915b918618 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Aug 23 22:40:25.285749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 493/963] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:25.791190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:25.793390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:25.799975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:25.800463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:25.800897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:25.801623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:25.802080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:25.802504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:25.832146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-332e8ffb-f035-495a-adc6-57d34176391d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 23 22:40:25.832624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 471/964] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:26.047376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:26.047982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:26.054410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.054900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.055377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.056072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.056537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.056954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.189062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:26.198065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:26.199499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:26.200648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85117519-1e7d-49c0-8370-dcc856af8218 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157771 Aug 23 22:40:26.201353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 494/965] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:26.297742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:26.299916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:26.306316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.306796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.307226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.307910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.308359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.308776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.312643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:26.337391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-72bc7c41-f76d-42b3-9139-caf91042b905 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Aug 23 22:40:26.337947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 472/966] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:26.844016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:26.846107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:26.851998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.852484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.852918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.853637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:26.854093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:26.854544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:26.884340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c954890-87b5-4ba4-bb0d-09f852841270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Aug 23 22:40:26.884895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 495/967] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:27.225247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:27.225892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:27.232090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.232643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.233154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.234625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.235115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.235505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.350138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:27.353079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:27.360159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.360675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.361195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.361936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.362393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.362842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.365807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:27.374882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:27.376403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:27.377684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-62a980a4-268c-49a8-bd6b-4af26bec184b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.156994 Aug 23 22:40:27.378249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 473/968] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:27 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:27.393930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0680e77-1853-45a6-bfdd-9c2938bb5cde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Aug 23 22:40:27.394486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 496/969] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:27.896813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:27.899013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:27.905172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.906236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.906698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.907463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:27.908021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:27.908449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:27.938272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a8040041-bfdc-4961-b139-a87e2cfa4166 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Aug 23 22:40:27.938826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 474/970] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:28.401898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:28.402523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:28.407787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:28.410027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:28.415227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.415227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.415227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.415227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.415549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.415549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.416885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.417397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.417960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.418857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.419305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.419722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.454390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4f5e4d59-1022-4d18-a2bf-d8ec4f7a7149 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051445 Aug 23 22:40:28.454967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 475/971] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:28.549775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:28.559943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:28.562326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:28.563628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3f08c78-7e1e-4fb6-9599-27cfe9633761 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.165765 Aug 23 22:40:28.564300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 497/972] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:28.950311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:28.952582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:28.959007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.959489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.959927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.960622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:28.961152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:28.961571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:28.991398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2d3a3cf6-a913-47ff-82cd-c9cd50f4c889 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Aug 23 22:40:28.991946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 476/973] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:29.467248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:29.469481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:29.475980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:29.476488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:29.476913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:29.477621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:29.478065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:29.478484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:29.508796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aefe2f1a-0dca-4376-acdd-594ddb025af3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Aug 23 22:40:29.509518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 498/974] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:29.588192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:29.588818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:29.595847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:29.596334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:29.596768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:29.597498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:29.597978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:29.598427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:29.734876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:29.743766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:29.745365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:29.746517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb23fd4a-1f83-408e-a899-0e098aa387b7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162301 Aug 23 22:40:29.747069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 477/975] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:30.004043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:30.007643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:30.013668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.014148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.014681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.015425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.015886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.016299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.047761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93daa629-463c-445c-a12d-8886741e1cda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047921 Aug 23 22:40:30.048314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 499/976] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:30.521881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:30.524071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:30.531064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.531964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.532442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.533171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.533635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.534060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.564747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ba305200-fdbf-4d0f-9de8-50c7dae4b964 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046974 Aug 23 22:40:30.565364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 478/977] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:30.771500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:30.772195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:30.778136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.778621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.779046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.779726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:30.780292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:30.780813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:30.919751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:30.929897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:30.931468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:30.932654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-df676420-1b90-4fe6-be36-8c3e52e072ad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.165268 Aug 23 22:40:30.933251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 500/978] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:31.060127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:31.062471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:31.068964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.069486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.069929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:31.070629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.071087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.071512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:31.102221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eb810e52-5f4c-489a-a70e-b49d6a000eb4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Aug 23 22:40:31.104073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 479/979] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:31.578369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:31.581424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:31.588104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.588592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.589047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:31.589804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.590326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.590771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:31.623467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f1a137d-b5d6-44e9-989f-0ff2a0912145 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049517 Aug 23 22:40:31.624069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 501/980] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:31.956872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:31.957536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:31.967077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.967562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.968003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:31.968700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:31.969185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:31.970559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:32.105435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:32.114715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:32.114955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:32.116217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:32.117286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:32.117426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-967820f1-aa52-4182-b044-e8436f2291e7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.165742 Aug 23 22:40:32.117976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 480/981] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:32.123227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:32.123715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:32.124154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:32.124857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:32.125341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:32.125768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:32.155826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d21dd9f-ea86-46a0-97af-cfe85adcd250 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 23 22:40:32.156380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 502/982] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:32.636972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:32.639143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:32.645280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:32.645764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:32.646199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:32.646879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:32.647327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:32.647746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:32.677605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-61c13e0c-dea5-41a5-b486-eaa3129df124 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Aug 23 22:40:32.678161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 481/983] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:33.141113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:33.141896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:33.148246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.148717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.149185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.149968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.150405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.150818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.167874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:33.170204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:33.177357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.177892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.178328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.179065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.179521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.179947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.211129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b5bb144b-2c30-494f-9bd4-651193754ac1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Aug 23 22:40:33.211923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 482/984] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:33.285467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:33.294345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:33.295825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:33.296962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-deaf44de-1e59-438c-8f72-01d8e34de7c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159887 Aug 23 22:40:33.297531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 503/985] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:33.691130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:33.693307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:33.699260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.699796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.700225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.700911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:33.701387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:33.701804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:33.732399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a5a3dbb9-8177-4bab-b26e-3eef074740cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 23 22:40:33.732964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 483/986] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:34.225346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:34.227690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:34.234666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.235152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.235592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.236887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.237413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.237919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.269552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b79a958-b3a5-4e99-bb66-9f39c037a1f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048519 Aug 23 22:40:34.270125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 504/987] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:34.320600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:34.321359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:34.327774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.328507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.328940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.329717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.330235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.330695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.457550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:34.466082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:34.467568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:34.468707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ec9baac7-3856-4a3e-889a-35cc75d6334f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.152092 Aug 23 22:40:34.469286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 484/988] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:34.744975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:34.747111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:34.753536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.754031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.754467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.755201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:34.755651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:34.756076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:34.758652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:34.786602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-01fbfcfc-ceef-49f9-b659-b09a37bad7f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Aug 23 22:40:34.787440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 505/989] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:35.287398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:35.289915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:35.295954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.296442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.296889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.297705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.298156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.298628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.330695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6dfdd3b6-abc7-4c01-a12f-65cff13b763b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046771 Aug 23 22:40:35.331324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 485/990] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:35.492373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:35.492979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:35.499530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.500014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.500447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.501161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.502484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.502910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.637003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:35.645957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:35.647568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:35.648727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-51d19132-fa04-45eb-a67a-ef400d7c20fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.161043 Aug 23 22:40:35.649434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 506/991] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:35.799889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:35.802090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:35.808037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.808456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.808885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.809593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.810045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.810459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.841310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3431c6cd-0fdd-4e0e-94af-37b826247e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Aug 23 22:40:35.841872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 486/992] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:35.895774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:35.896270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:35.902149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.902630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.903066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.903749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:35.904201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:35.904622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:35.928622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2443cf28-9b33-408f-9301-7dabce19f277 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633/ips" status: 200 len: 144 microversion: 2.1 time: 0.037073 Aug 23 22:40:35.929215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 507/993] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 22:40:35 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:36.343152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:36.346175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:36.352474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.352961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.353420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.354113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.354563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.354988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.390320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4b4ed4c0-ac0c-471c-8ef3-99f9e78325c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050981 Aug 23 22:40:36.390823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 487/994] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:36.671843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:36.672561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:36.680472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.680963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.681429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.682128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.682575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.682989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.817718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:36.826945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:36.828707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:36.830007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1d8ba6a6-defe-466a-be4d-5168cda69884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162059 Aug 23 22:40:36.830565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 508/995] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:36.853558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:36.855691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:36.862708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.863219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.863769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.864365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:36.864816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:36.865265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:36.889610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:36.894296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aba27c70-d0fe-4f75-930f-1f941bdce363 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 23 22:40:36.894856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 488/996] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:37.403059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:37.405223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:37.411743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.412223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.412659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.413369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.413819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.414241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.444021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7abc714a-34d0-419f-9044-1fbd1f4a6890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Aug 23 22:40:37.444573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 509/997] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:37.853827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:37.854427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:37.860767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.861268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.861700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.862433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.862874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.863290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.906043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:37.908221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:37.915551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.915966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.916403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.917125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:37.917582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:37.918000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:37.947476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-80c41b63-bd58-4084-abd2-fc9b522bbf9d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Aug 23 22:40:37.948042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 510/998] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:37.995841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:38.004732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:38.006275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:38.007420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-47833eac-c7f7-48bb-b52b-564794794668 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157912 Aug 23 22:40:38.007965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 489/999] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:38.456393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:38.459428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:38.465501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:38.465986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:38.466450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:38.467170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:38.467625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:38.468091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:38.499537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7954bc15-70a6-4173-a9ac-d9edfea5e0ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Aug 23 22:40:38.504655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 511/1000] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:38.960315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:38.962554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:38.969194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:38.969676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:38.970110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:38.970808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:38.971278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:38.971703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:39.002198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e7082ced-d057-4971-b903-f6cc9ab15188 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Aug 23 22:40:39.002762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 490/1001] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:39.030452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:39.031059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:39.038122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:39.038617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:39.039055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:39.039752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:39.040208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:39.040637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:39.174107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:39.183356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:39.184961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:39.186073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4340fc77-1f52-44e8-a83d-0ae24869a62e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159597 Aug 23 22:40:39.186628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 512/1002] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:39.512968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:39.515183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:39.521746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:39.522237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:39.522672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:39.523363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:39.523843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:39.524270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:39.553576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-39d48962-39f2-4577-a6de-99c52fa6b1de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Aug 23 22:40:39.554145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 491/1003] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:40.015278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:40.017854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:40.025402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.025948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.026380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.027130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.027651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.028165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.062792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cf10105a-eaf1-4ffd-a257-97be17a4aecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052301 Aug 23 22:40:40.063480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 513/1004] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:40.210382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:40.211046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:40.217782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.218275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.218713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.219408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.219863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.220289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.358155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:40.367492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:40.369038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:40.370193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bb151839-4b61-438b-a1c6-596add21ba46 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164611 Aug 23 22:40:40.370751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 492/1005] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:40 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:40.566092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:40.570899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:40.574910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.575386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.575824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.576512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:40.576962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:40.577507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:40.607656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-60a7c00d-4f22-486a-9215-f2f2fdbe2dda tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 Aug 23 22:40:40.608209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 514/1006] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:41.075444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:41.077917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:41.084548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.085049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.085494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.086190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.086652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.087077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.115211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6aceefc4-d74a-4b56-95d2-b7b62dd9c6a0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Aug 23 22:40:41.115754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 493/1007] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:41.394231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:41.394780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:41.401896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.402376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.402808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.403489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.403936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.404357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.534953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:41.543574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:41.545079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:41.546226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4ab812b4-3b4e-4d3d-ba7d-6992d5d2ffd4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.155966 Aug 23 22:40:41.546776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 515/1008] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:41.620698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:41.623107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:41.629840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.630320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.631454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.632167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:41.632616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:41.633054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:41.665882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ad8ecf5-8cff-4652-8d13-a4bd4bffaf5c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049221 Aug 23 22:40:41.666547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 494/1009] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:42.127030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:42.129206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:42.135188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.135667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.136098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.136783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.137414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.137841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.168843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6f19dc17-c390-4876-acd4-b2253140f387 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Aug 23 22:40:42.169433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 516/1010] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:42.570080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:42.570677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:42.576562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.577070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.577505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.578474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.578921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.579340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.678539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:42.680876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:42.687218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.687719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.688231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.688850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:42.689365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:42.689783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:42.723632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a0649ff-cb50-4acd-840d-3573125fc3c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048762 Aug 23 22:40:42.724379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 517/1011] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:42.726848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:42.735476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:42.736985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:42.738200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-63c16020-bb38-4b48-a345-98dcc63ad2da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.172803 Aug 23 22:40:42.738746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 495/1012] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:43.181753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:43.183851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:43.189932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.190418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.190857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.191548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.191999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.192421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.223474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a9e5e74-5559-4a2f-9f9b-78fc716325f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Aug 23 22:40:43.224037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 518/1013] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:43.735865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:43.738065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:43.743972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=82 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:43.745508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.745995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.746506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.747207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.747660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.748085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.760441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:43.761093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:43.767494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.767971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.768401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.769118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:43.769570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:43.769990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:43.781482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-94fd053c-d5be-436f-aafd-db5e9115e9fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 Aug 23 22:40:43.781714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 496/1014] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:43.900008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:43.908676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:43.910207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:43.911362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3103fa06-6f0d-4d41-b097-7de557e0b233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.154908 Aug 23 22:40:43.912503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 519/1015] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:44.236178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:44.238345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:44.244579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.245100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.245537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:44.246226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.246680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.247102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:44.278145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57d9c707-18af-48ce-a507-1d0a58f760ca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Aug 23 22:40:44.278714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 497/1016] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:44.793116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:44.795536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:44.797961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=82 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:44.802767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.803249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.804399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:44.805236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.805605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.806029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:44.836411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0bdde82-3010-43f7-93bb-8f30df5a7600 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Aug 23 22:40:44.836903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 520/1017] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:44.934921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:44.935646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:44.942502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.948684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.948684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:44.948684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:44.948684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:44.949288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:45.083306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:45.092662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:45.094240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:45.095437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f7de9d98-bb4f-417a-a93f-4593bdd138c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164727 Aug 23 22:40:45.096114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 498/1018] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:45.292045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:45.294297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:45.300386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:45.300901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:45.301444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:45.302142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:45.302624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:45.303053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:45.337965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f3e5bca0-9711-492e-8e92-c5655397f185 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051095 Aug 23 22:40:45.338533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 521/1019] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:45.848460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:45.852533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:45.858578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:45.859185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:45.859778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:45.860752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:45.861345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:45.861875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:45.897722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0eff1bd8-414d-44cf-97ad-d982be26e15e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053495 Aug 23 22:40:45.898309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 499/1020] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:46.120440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:46.120974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:46.127392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.127875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.128314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.129134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.129513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.129934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.133405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:46.263611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:46.272442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:46.274174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:46.275343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5b41a56a-ff2f-4050-95e0-2b6b15e3f113 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.159598 Aug 23 22:40:46.275895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 522/1021] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:46.351177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:46.353443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:46.360887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.360887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.361316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.361678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.362137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.363387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.394717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bf744745-1df8-4f1b-b215-8e495d427e49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Aug 23 22:40:46.395191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 500/1022] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:46.910672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:46.912769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:46.920109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.920618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.921087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.921785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:46.922239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:46.922667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:46.951574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c2cf32c0-9e79-4724-aaac-33904b46f808 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Aug 23 22:40:46.952130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 523/1023] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:47.298094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:47.298707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:47.305805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.306292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.306722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:47.307415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.307860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.308276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:47.406879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:47.409366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:47.416669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.417302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.417815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:47.418588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.419130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.419541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:47.443710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:47.448772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a7c194b3-cbbe-43e9-9b2e-e817d73cc949 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Aug 23 22:40:47.449390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 524/1024] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:47.453256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:47.454909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:47.456231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a3c64be2-d45e-4d8f-99fe-c172c195c014 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162335 Aug 23 22:40:47.456795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 501/1025] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:47.964532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:47.966739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:47.972791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.973310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.973750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:47.974446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:47.974901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:47.975341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:48.004331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c07cb548-d8bd-42d0-b8e7-ba768447a608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 23 22:40:48.004880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 525/1026] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:48.461073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:48.463633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:48.471915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:48.472398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:48.472838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:48.473605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:48.474167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:48.474631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:48.479524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:48.480349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:48.486932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:48.487362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:48.487801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:48.488529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:48.488976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:48.489463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:48.507502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-480d88bf-1f36-46ab-a54f-1ed9f145d9d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050011 Aug 23 22:40:48.508491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 502/1027] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:48.622172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:48.631444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:48.632988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:48.634188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ebf4e8e3-0d8a-450e-8446-11435531f531 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.158862 Aug 23 22:40:48.634745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 526/1028] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:40:49.017657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:49.019784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:49.026384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.026862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.027288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.027967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.028442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.028861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.058650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-06222b20-60ac-40b9-9d6f-ede5dd6a8d29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Aug 23 22:40:49.059199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 503/1029] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:49.520453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:49.523403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:49.529936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.530441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.530877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.531567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.532018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.532440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.563134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e63dcb25-eea2-4d81-96c7-568afe7a6e73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Aug 23 22:40:49.563699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 527/1030] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:49.658045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:49.658754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:49.665451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.665944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.666883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.667081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:49.667513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:49.667931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:49.800569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:49.810085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:49.811762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:49.812944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8fce389a-df5d-4367-9d14-014e5d3eaa05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.158878 Aug 23 22:40:49.813539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 504/1031] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:50.071378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:50.073544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:50.080061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.080597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.081095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.081838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.082295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.082765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.112676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-05a4498e-1f10-4d51-a880-fc69812d8e31 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Aug 23 22:40:50.113265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 528/1032] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:50.576033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:50.578521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:50.585502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.585983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.586410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.587096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.587540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.587959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.603417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:50.618424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9c9a3f9f-f85f-4e1c-9b59-665fb202f427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046482 Aug 23 22:40:50.618972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 505/1033] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:50.837858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:50.838398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:50.844713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.845231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.845659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.846337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:50.846780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:50.847192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:50.982248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:50.990658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:50.992148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:50.993318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c7f9b922-055e-46ee-aa9f-688db33d6b9a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160124 Aug 23 22:40:50.993862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 529/1034] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:51.128799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:51.131059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:51.138836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:51.139311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:51.139766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:51.140483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:51.140931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:51.141375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:51.171531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0d5917c6-d42c-4b21-9ae2-e7f0304f97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Aug 23 22:40:51.172106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 506/1035] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:51.630836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:51.633040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:51.639395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:51.639877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:51.640321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:51.641068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:51.641524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:51.641945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:51.672880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e675572-a087-426a-89f2-48be1cea3b14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045991 Aug 23 22:40:51.673495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 530/1036] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:52.017349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:52.017957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:52.024104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.024589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.025049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.025747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.026197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.026617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.164449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:52.173650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:52.175215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:52.176396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0a566390-767e-4eeb-85eb-29a7dc896621 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.163021 Aug 23 22:40:52.176995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 507/1037] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:52.184547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:52.186719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:52.193583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.193915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.194368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.195832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.196306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.196721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.226791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-17dfc20a-8275-4a70-aadf-6fb3a36b56f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 23 22:40:52.227329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 531/1038] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:52.685415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:52.687566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:52.693505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.693990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.694454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.695142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:52.695592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:52.696014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:52.725384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-108049f3-3989-4d6e-9006-a669969f5273 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Aug 23 22:40:52.727744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 508/1039] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:53.200479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:53.201111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:53.207803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.208279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.208733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.209459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.209905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.210983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.238768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:53.240876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:53.247427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.247915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.248384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.249111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.249571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.250334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.281243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f4f24315-e397-4881-90ac-85567a507268 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Aug 23 22:40:53.281815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 509/1040] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:53.341059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:53.349604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:53.351225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:53.352375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4a7dd68a-6afa-4351-90f8-7f0c5a520625 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.155896 Aug 23 22:40:53.352930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 532/1041] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:53.738672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:53.740831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:53.747669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.748158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.748595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.749420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:53.749878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:53.750302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:53.779747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fda17270-20f0-4dba-844a-4d252ca54028 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Aug 23 22:40:53.780416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 510/1042] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:54.294714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:54.297310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:54.304446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.304977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.305445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.306301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.306760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.307261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.337713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9a435bf6-7dd0-4e91-a820-704afc8e627c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Aug 23 22:40:54.338272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 533/1043] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:54.375381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:54.375989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:54.382473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.382961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.383397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.384091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.384541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.384963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.530741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:54.539579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:54.541116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:54.542268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-964a71b8-376d-46bb-98af-d9285271db2a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.170901 Aug 23 22:40:54.542817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 511/1044] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:54.792613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:54.794915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:54.800896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.801407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.816072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.816072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:54.816072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:54.816072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:54.833585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f3eef360-2443-4554-916b-e619ed7ec15d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Aug 23 22:40:54.834184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 534/1045] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:55.350303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:55.353042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:55.358984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.359467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.359891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.360572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.361035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.361464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.390994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f03f2088-35ce-47d2-8451-34ec40cba96e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Aug 23 22:40:55.391638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 512/1046] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:55.565153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:55.565761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:55.572394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.572961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.573570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.574348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.574870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.575337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.713973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:55.723042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:55.724548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:55.725853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-77be7d8d-3c73-4b64-82e5-7791557bbd47 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.164597 Aug 23 22:40:55.726477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 535/1047] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:55.846925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:55.849168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:55.855689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.856171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.856601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.857321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:55.857778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:55.858199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:55.888018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e86694fb-f602-4af6-a771-6dbe5fbe3752 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Aug 23 22:40:55.888575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 513/1048] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:56.403673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:56.405771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:56.411715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.412318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.412756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.413479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.413934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.414357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.446389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-38aeeaf4-a9f5-46be-9e99-8f4d9c03b82c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Aug 23 22:40:56.447001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 536/1049] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:56.749079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:56.749665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:56.756154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.760740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.760740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.760740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.760740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.761400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.889968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:56.898747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:56.900089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:56.900607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:56.902488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3c1a2658-1fda-42b4-b474-59f663834036 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157088 Aug 23 22:40:56.903216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 514/1050] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:56.903368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:56.909711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.910201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.910642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.911336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:56.911787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:56.912210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:56.941047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3970e225-fb94-41f8-a98e-ab871bf16af8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Aug 23 22:40:56.941593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 537/1051] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:57.459416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:57.461865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:57.468886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.469517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.470008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.470746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.471297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.471794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.508812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a100c8e1-d9c4-4e24-80ff-56343d3c7aa3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053274 Aug 23 22:40:57.509552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 515/1052] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:57.925353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:57.925896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:57.932240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.932714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.933524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.934372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.934850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.935275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.955071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:57.957774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:57.965197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.965686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.966124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.966827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:57.967284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:57.967707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:57.999157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-da028dfc-fe2e-4007-a9b4-71fcb0febc5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049411 Aug 23 22:40:57.999823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 516/1053] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:58.069538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:58.071814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:58.081032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:58.082760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:58.083673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0b0fb643-3d0b-41e5-8ee6-47e1c7abb853 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.162413 Aug 23 22:40:58.084222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 538/1054] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:58.522448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:58.524583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:58.531528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:58.532004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:58.532439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:58.533163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:58.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:58.534026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:58.566312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c41e7239-cbea-4f23-9787-158aaf3762f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Aug 23 22:40:58.566312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 517/1055] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:40:59.012045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:59.014943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:59.021623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.022108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.022544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.023230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.023678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.024102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.053315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1c5e043c-f8b4-4611-b559-ada8f7b7499a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Aug 23 22:40:59.053858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 539/1056] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:40:59.107508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:59.108111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:59.114605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.115085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.115594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.116283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.116740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.117201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.251615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:59.260481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:59.262036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:40:59.264213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-009be1e2-f8a3-4c66-a9ad-7cf9d06313d2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.160216 Aug 23 22:40:59.264731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 518/1057] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:40:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:40:59.580479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:40:59.582701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:40:59.588804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.589306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.589747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.591193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:40:59.591757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:40:59.592371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:40:59.622362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-22e4e824-0397-4033-be30-92d4ff33bdba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Aug 23 22:40:59.622931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 540/1058] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:40:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:00.066124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:00.068300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:00.074391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.074943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.076056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.076761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.077514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.077934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.107292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa75d2ad-777c-4ec4-b9d5-b71c92c2e41b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Aug 23 22:41:00.107848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 519/1059] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:00.286718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:00.287321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:00.294377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.295052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.295499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.296214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.296676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.297139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.428524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:00.437260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:00.445308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:00.445308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a4a628e-f494-4790-ae85-a2ddc5c55044 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1751 microversion: 2.20 time: 0.157295 Aug 23 22:41:00.445308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 541/1060] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:00.634039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:00.636307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:00.643276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.643761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.644202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.644882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:00.645432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:00.645836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:00.678252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2bb92386-daf9-461b-a45a-7663617c2324 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048098 Aug 23 22:41:00.678817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 520/1061] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:01.119608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:01.122546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:01.128597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.129106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.129955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.130254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.130722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.131166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.160307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b641a390-17f7-4af4-80ac-7a67f16cc9e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Aug 23 22:41:01.160861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 542/1062] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:01.464108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:01.464665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:01.470996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.471471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.471904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.472592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.473065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.473489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.603848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:01.612575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:01.614104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:01.615261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ce69ef1-3df2-43b4-816c-6888ed0cbb56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.155592 Aug 23 22:41:01.615816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 521/1063] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:01.692110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:01.694278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:01.700553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.701298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.701731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.703325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:01.703849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:01.704270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:01.732817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-37fd9c14-e14b-4f22-b581-3b25b81a5bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Aug 23 22:41:01.733335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 543/1064] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:02.173155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:02.175316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:02.182141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.182630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.183068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.183769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.184226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.184651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.187173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:02.215048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-47d9309f-1519-45c7-a781-2ea9447d8e2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046861 Aug 23 22:41:02.215599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 522/1065] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:02.638782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:02.639393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:02.645926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.646405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.646839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.647522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.647974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.648393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.745472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:02.747791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:02.754056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.754542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.754980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.755676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:02.756131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:02.756557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:02.783134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:02.788344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-354794e5-4976-4188-9574-e98e0a76ba5a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Aug 23 22:41:02.788931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 523/1066] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:02.792134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:02.793682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:02.794846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-346fb2ca-1a03-4666-8a13-4905830acfca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159990 Aug 23 22:41:02.795393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 544/1067] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:03.228069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:03.230510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:03.237167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.237657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.238089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.238776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.239222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.239636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.270593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dbfbd77e-922b-4866-a782-7fb0243f6c1b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Aug 23 22:41:03.271978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 524/1068] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:03.801598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:03.803814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:03.810835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.811225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.811676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.812811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.813305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.813738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.817897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:03.830602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:03.830602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.830602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.830602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.831085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:03.831085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:03.831085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:03.848264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3c2aaa3b-99d7-483a-bf13-243748746230 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051772 Aug 23 22:41:03.848894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 545/1069] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:03.960255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:03.970032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:03.971616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:03.972777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3540ccbc-2a2e-4551-9ed3-4d39de066d2b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158996 Aug 23 22:41:03.973374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 525/1070] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:04.283348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:04.285501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:04.291423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:04.291973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:04.292407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:04.293122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:04.293567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:04.293984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:04.325357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-398145c3-39b7-4734-9f63-ac5156f58843 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Aug 23 22:41:04.326112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 546/1071] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:04.861072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:04.863182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:04.869919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:04.870407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:04.870849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:04.871653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:04.872110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:04.872569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:04.903525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-47f5ccf3-4b03-4bdf-a9fd-fc91b0583109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 23 22:41:04.904080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 526/1072] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:04.996280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:04.996966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:05.006829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.007596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.008256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.009089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.009621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.010328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.146245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:05.154860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:05.156927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:05.158102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c65c65e3-24ad-4208-bd3e-c91635e55486 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.165907 Aug 23 22:41:05.158658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 547/1073] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:05.339595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:05.341918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:05.352534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.353052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.353499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.354200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.354685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.355107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.384539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2fbb444a-afd5-4fde-a901-f0e46f048c5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048976 Aug 23 22:41:05.385109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 527/1074] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:05.916043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:05.918143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:05.924766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.925261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.925688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.926370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:05.926814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:05.927226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:05.956701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-440c9720-c595-47c2-aa8e-3923f8f36bfc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Aug 23 22:41:05.957293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 548/1075] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:06.181709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:06.182237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:06.189220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.189704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.190165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:06.190858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.191306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.191786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:06.327832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:06.336774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:06.338355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:06.339525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ea4bc3d-633e-4263-994a-904ab0ad33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162047 Aug 23 22:41:06.340080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 528/1076] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:06.395875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:06.398067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:06.404507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.405035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.405499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:06.406269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.406725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.407143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:06.437113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1b0bce0-1d27-4f9a-b4c1-c01087add1fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 23 22:41:06.437545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 549/1077] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:06.969174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:06.971344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:06.977222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.977698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.978122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:06.978797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:06.979240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:06.979654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:07.008936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-32ce2aeb-1c00-4536-8bc0-2416062a7890 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Aug 23 22:41:07.009511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 529/1078] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:07.363873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:07.364406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:07.370645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:07.371124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:07.371552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:07.372234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:07.372679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:07.373131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:07.449930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:07.458529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:07.458885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:07.459335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:07.459770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:07.460470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:07.460929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:07.461396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:07.492315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f5666107-915c-4ba9-8abb-feed34638f37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Aug 23 22:41:07.492894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 530/1079] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:07.509951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:07.518807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:07.520313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:07.521499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-51645ea9-43f9-4a88-a30b-22982f4b4267 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162244 Aug 23 22:41:07.522058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 550/1080] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:08.022767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:08.024928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:08.030976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.031461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.031903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.032603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.033085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.033514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.064441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-66f1cc38-55a7-4af7-afee-e021e30e535c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Aug 23 22:41:08.065563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 531/1081] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:08.504104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:08.506475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:08.513003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.513627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.514006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.514733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.515185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.515609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.545660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:08.546286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:08.547104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b2a83b5-32b7-4286-80d0-639da6c1f457 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047016 Aug 23 22:41:08.547878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 551/1082] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:08.553315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.554228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.554880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.555815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:08.556329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:08.556967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:08.754548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:08.763609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:08.765160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:08.766429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8c5ecc4-7de2-479b-9f8d-d12cac644aad tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.225522 Aug 23 22:41:08.767005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 532/1083] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:09.082417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:09.084724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:09.091000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.091485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.091929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.092611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.093076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.093497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.126647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-523c7332-5cf4-4ddc-b6fa-57989f4fa427 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051956 Aug 23 22:41:09.127291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 552/1084] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:09.562097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:09.563988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:09.573560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.574058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.574494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.575200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.575657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.576082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.609353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f270a4f9-bbd1-4c96-be24-26da257d7cd0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053360 Aug 23 22:41:09.609923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 533/1085] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:09.789993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:09.790592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:09.797136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.799160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.799160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.799160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:09.799160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:09.800267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:09.930636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:09.939347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:09.941113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:09.942272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb4da63d-6b67-40ec-836a-53533db652cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156287 Aug 23 22:41:09.942829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 553/1086] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:10.140153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:10.142280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:10.148703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.149227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.149666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:10.150355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.150806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.151229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:10.181213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-17e49c26-f031-4d5e-87fc-d1cbbf63b766 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Aug 23 22:41:10.181751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 534/1087] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:10.622981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:10.625204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:10.632808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.633473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.633953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:10.634922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.635584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.636164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:10.668147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2557c41c-372d-40a6-843d-2fe99da3948d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048998 Aug 23 22:41:10.668702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 554/1088] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:10.966234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:10.966828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:10.974502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.974987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.975416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:10.976140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:10.976612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:10.977070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:11.117669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:11.126793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:11.128330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:11.129540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1368a23e-3a01-4922-bab1-73264cf35ef0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167278 Aug 23 22:41:11.130102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 535/1089] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:11.194089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:11.196250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:11.203054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:11.203543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:11.203980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:11.204696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:11.205189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:11.205620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:11.219586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:11.240387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02a5c4d3-a803-42b5-933e-154f71cadbd6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050526 Aug 23 22:41:11.240941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 555/1090] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:11.681363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:11.683565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:11.689670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:11.690871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:11.691306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:11.692006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:11.692461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:11.692887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:11.721359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-60170c47-3397-45a8-a2f9-8411744d45cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 23 22:41:11.721914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 536/1091] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:12.152926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:12.153555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:12.160260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.160737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.161210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.161898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.162345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.162765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.251978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:12.254413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:12.261156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.261676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.262165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.262852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.263430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.263738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.293180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:12.295727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-304d4835-475a-4d09-b6fc-96f9fdd3ae86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 Aug 23 22:41:12.296303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 537/1092] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:12.301876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:12.303371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:12.304523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7e0e1cee-7441-4b84-b932-6bf5814648e3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.155884 Aug 23 22:41:12.305089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 556/1093] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:12.733696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:12.735870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:12.741946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.742431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.742869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.743562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:12.744019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:12.744444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:12.768809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:12.777241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-efd7f2f7-1b8b-4b6f-910f-f72b0dfcf6b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 23 22:41:12.777241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 538/1094] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:13.307403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:13.309595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:13.316153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.316633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.317090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.317775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.318222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.318641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.327418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:13.328032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:13.335133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.335622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.336060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.336761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.337244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.337674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.348882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3699264f-246b-4bb4-901f-386f34f37077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Aug 23 22:41:13.349474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 557/1095] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:13.470452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:13.479875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:13.481410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:13.482574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-30dbe794-0a15-4909-b12c-a428255f2d98 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159403 Aug 23 22:41:13.483129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 539/1096] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:13.788505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:13.790662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:13.796581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.797097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.797543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.798241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:13.798691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:13.799110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:13.828340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-839d8546-2fd8-4a77-9976-42a2722df675 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 23 22:41:13.828828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 558/1097] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:14.361725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:14.364514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:14.366869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=88 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:14.371557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.378380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.378380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.378380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.378380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.378794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.403956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a0fdbe1e-1a81-442f-9d42-de76cbb09c9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Aug 23 22:41:14.404573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 540/1098] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:14.506787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:14.507405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:14.513947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.514427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.514860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.515543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.515989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.516408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.650031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:14.660143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:14.661863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:14.663042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae168b16-c781-40b8-abc3-52126c1da04a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160928 Aug 23 22:41:14.663600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 559/1099] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:14.841273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:14.843550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:14.849732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.854430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.854430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.854430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:14.854430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:14.854897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:14.882077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8394930-1d17-4b65-a2bd-20c335d21c45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 Aug 23 22:41:14.882644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 541/1100] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:15.344219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:41:15.344471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:41:15.416490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:15.418713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:15.420592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=80 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:15.425931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.431390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.431390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.431390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.431390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.431805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.459557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-13db0822-c7da-4e6c-852d-d54c6a689000 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 23 22:41:15.460117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 560/1101] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:15.685966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:15.686644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:15.693615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.694108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.694547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.695255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.695716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.696133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.894038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:15.896345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:15.902650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.903107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.903547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.904254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:15.904709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:15.905165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:15.926702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:15.935696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:15.936976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1f00a534-f536-4cd4-a10b-cb0e6843938a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046915 Aug 23 22:41:15.937444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:15.937601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 561/1102] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:15.938603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7b098b8e-41c5-48b6-a62e-b2966de40f60 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.256815 Aug 23 22:41:15.939138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 542/1103] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:16.472253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:16.474440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:16.480595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.481106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.481548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.482295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.482747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.483173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.514343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-319fcfa6-11d8-41e0-a9a0-d62609e69e69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Aug 23 22:41:16.514913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 562/1104] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:16.949808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:16.952244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:16.958792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.959274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.959709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.960401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.960855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.961304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.962017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:16.962665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:16.968917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.969442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.969882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.970577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:16.971030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:16.971540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:16.991981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d00bf2a4-e290-47e6-8ee5-71a79b128670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Aug 23 22:41:16.992546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 543/1105] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:17.032939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:41:17.033179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc (ip 10.222.0.73) !!! Aug 23 22:41:17.105876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:17.114796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:17.116289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:17.117472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-394806ea-5f7a-48c0-a246-46f9f64ad95f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159427 Aug 23 22:41:17.118013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 563/1106] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:17.527474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:17.529760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:17.535925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:17.536434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:17.536872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:17.537603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:17.538064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:17.538491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:17.571084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-283053e6-0f3f-43b2-b41c-bb47749c11f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047674 Aug 23 22:41:17.571642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 544/1107] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:18.004496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:18.006669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:18.013189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.013677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.014116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.014814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.015269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.015692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.044727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ee66ed41-5d7e-420e-9302-d87b9de219bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Aug 23 22:41:18.045338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 564/1108] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:18.142332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:18.142944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:18.150045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.150527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.150960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.151697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.152147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.152569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.287367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:18.295902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:18.297431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:18.298598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7e3cbd59-73d8-4c2b-9bac-a87558dae16c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160591 Aug 23 22:41:18.299153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 545/1109] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:18.586800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:18.588960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:18.595026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.595509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.595951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.596756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:18.597423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:18.597854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:18.628802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1545fa1f-6e21-49d4-a2b0-923992dc8f04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048688 Aug 23 22:41:18.629388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 565/1110] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:19.056815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:19.059039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:19.065745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.066245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.066715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.067413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.067868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.068310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.096785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cccdb244-870f-43a2-9b08-d5e97aab9325 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Aug 23 22:41:19.097478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 546/1111] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:19.321480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:19.322149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:19.328664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.329185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.329624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.330413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.330867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.331319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.514079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:19.522509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:19.523999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:19.525169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-89753cfa-6d1e-4e2b-9554-f564deda0484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.207889 Aug 23 22:41:19.525719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 566/1112] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:19.641371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:19.645273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:19.649939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.650418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.650850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.651542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:19.651989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:19.652410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:19.682782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ab16fd21-4992-4008-8e00-0665ba4a06f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Aug 23 22:41:19.683320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 547/1113] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:20.110426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:20.112609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:20.118555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.119028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.119474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.120127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.120567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.120983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.161641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-89e18f1b-a425-4689-85aa-3769d1a84ed6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055730 Aug 23 22:41:20.162200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 567/1114] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:20.548253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:20.548866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:20.555807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.556303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.556760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.557488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.557948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.558378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.696693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:20.699652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:20.702722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:20.707913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:20.709497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:20.710525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.710739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4387ccce-08cb-40df-ac7d-19861995c342 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166502 Aug 23 22:41:20.711129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.711288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 548/1115] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:20.711840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.713186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:20.714005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:20.714719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:20.762722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e0144d2c-266b-4890-acfa-ed9b55f64a04 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068492 Aug 23 22:41:20.763306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 568/1116] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:21.175126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:21.177336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:21.183480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.183961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.184400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.185128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.185588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.186051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.216392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ec29f966-07c7-4417-b8ce-24b4be08e918 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Aug 23 22:41:21.216954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 549/1117] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:21.754841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:21.755446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:21.761865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.762343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.762784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.763470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.763916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.764336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.775418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:21.777588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:21.784011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.784495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.785064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.785762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:21.786213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:21.786632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:21.817800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eae63c4d-15da-4332-a6bc-2764dbc9f062 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 23 22:41:21.818275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 550/1118] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:21.899075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:21.907962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:21.909910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:21.911065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ca79eb0c-39c8-4fc9-8630-57be26da33c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160824 Aug 23 22:41:21.911617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 569/1119] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:22.228906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:22.231082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:22.237730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.238226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.238666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:22.239373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.239829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.240249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:22.270352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f548bc47-8dad-4980-b972-2060942fa6fe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 23 22:41:22.270912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 551/1120] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:22.830359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:22.833216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:22.839662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.840152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.840594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:22.841309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.841765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.842223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:22.872068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0e5bc735-d8d6-4cbb-8906-066ea1c59815 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Aug 23 22:41:22.872631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 570/1121] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:22.934087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:22.934639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:22.941292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.941826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.942268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:22.942963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:22.943417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:22.943838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:23.076597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:23.086483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:23.088009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:23.089209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-30d14a4f-74a9-47c9-bfbf-61785b03c6ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159036 Aug 23 22:41:23.089768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 552/1122] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:23.282825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:23.285102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:23.291221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:23.291706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:23.292147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:23.292845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:23.293347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:23.293772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:23.322780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6db32edf-9c97-45ef-a894-b80eaa7ad86f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Aug 23 22:41:23.323331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 571/1123] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:23.884819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:23.887043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:23.893195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:23.893691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:23.894232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:23.895074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:23.895715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:23.896268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:23.932120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-59a4bf61-1e55-4d12-b1d3-fbaa5c183f81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052083 Aug 23 22:41:23.932849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 553/1124] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:24.113214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:24.114412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:24.120898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.121390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.121824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.122512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.122961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.123383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.125984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:24.257570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:24.266483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:24.268042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:24.269340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42f1c51b-f9b1-41cd-97b2-61ffb982fb7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160304 Aug 23 22:41:24.269892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 572/1125] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:24.336271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:24.338596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:24.345189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.345679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.346120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.346813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.347268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.347688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.379650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0acd8f52-b1a8-4c3d-a1c1-6d909ce7f0b8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Aug 23 22:41:24.380185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 554/1126] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:24.945527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:24.947966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:24.954582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.955114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.955587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.956292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:24.956750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:24.957208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:24.993045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d74455b-cd2b-4c7c-82af-de5a70f4b257 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052765 Aug 23 22:41:24.994305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 573/1127] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:25.293665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:25.294242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:25.300354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:25.300971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:25.301424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:25.302851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:25.303357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:25.303782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:25.319199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:25.391696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:25.393985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:25.400531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:25.401025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:25.401468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:25.402160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:25.402601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:25.403013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:25.433991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:25.434873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6bad787d-cbe7-4d9b-b5de-9730e98cb8be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 23 22:41:25.435505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 574/1128] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:25.443044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:25.444559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:25.445753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-435bd3ec-28d1-4421-8e0c-8b30e3e9896c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157000 Aug 23 22:41:25.446296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 555/1129] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:26.006215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:26.008354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:26.014347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.014821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.015249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.015928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.016369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.016783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.046934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b3f0df42-6ea3-431d-9ad6-14efda8197af tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Aug 23 22:41:26.047518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 575/1130] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:26.446495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:26.448671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:26.455370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.455841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.456271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.456954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.457425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.457840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.469317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:26.469995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:26.477753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.478259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.478728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.479431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:26.479882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:26.480307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:26.489546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fd3e3aca-8261-47b2-87f6-77b2842532f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Aug 23 22:41:26.490332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 556/1131] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:26.617934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:26.626681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:26.628192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:26.629388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1fee5765-252a-4348-a66a-2cc4c9add8b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164290 Aug 23 22:41:26.629985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 576/1132] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:27.059339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:27.061631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:27.067877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.068365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.069481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.070187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.070637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.071074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.110172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ac9f2502-85de-41a7-8669-75394e1545ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054995 Aug 23 22:41:27.110779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 557/1133] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:27.502077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:27.504204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:27.510802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.511299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.511739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.512421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.512869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.513325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.542146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93a77205-ba2f-4819-b3b8-3dd32f14ff50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 23 22:41:27.542704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 577/1134] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:27.652736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:27.653530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:27.660199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.661138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.661257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.661902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:27.662358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:27.662811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:27.798353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:27.807976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:27.809492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:27.810640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-853a72b1-2007-4f3f-8f72-636bcce7b423 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162043 Aug 23 22:41:27.811185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 558/1135] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:27 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:28.121734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:28.123883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:28.129849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.130335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.130768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.131456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.131908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.135934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.165180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d04b6b64-9795-4e3c-8023-e4fe47000bea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Aug 23 22:41:28.165748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 578/1136] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:28.556125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:28.558485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:28.564830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.565341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.565779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.566528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.566998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.567421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.600852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ae347640-9eac-43bd-b0da-8f24b0d763c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049823 Aug 23 22:41:28.602226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 559/1137] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:28.834440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:28.834978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:28.842398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.842885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.847375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.847375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:28.847375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:28.847375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:28.979729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:28.988481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:28.990005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:28.991146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02322e47-5c8a-45e1-acd9-07f4bd4fdf58 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160893 Aug 23 22:41:28.991746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 579/1138] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:29.177731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:29.179848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:29.186877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:29.187417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:29.187900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:29.188727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:29.189256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:29.189767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:29.223128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6d09a00-b245-4eb2-9ed1-440adf887e3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 Aug 23 22:41:29.223501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 560/1139] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:29.614044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:29.616179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:29.623158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:29.623666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:29.624094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:29.624804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:29.625298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:29.625713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:29.654948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-08413eac-1f26-4265-b4fa-4daf035873f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 23 22:41:29.655507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 580/1140] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:30.014127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:30.014739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:30.020653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.021172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.021610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.022295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.022825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.023263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.162978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:30.172545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:30.174101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:30.175351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be321bf7-cb33-4399-aeab-c59c91c37a3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.165119 Aug 23 22:41:30.175809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 561/1141] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:30.235883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:30.238099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:30.245116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.245629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.246092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.246791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.247238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.247661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.279836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fb99a866-f8ab-41d8-a635-0ad53a670ad5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Aug 23 22:41:30.280440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 581/1142] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:30.668181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:30.670434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:30.677307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.677817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.678251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.678989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:30.680286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:30.680796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:30.711975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fde8d44f-323c-42d4-89cb-938c8f3dc4dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048466 Aug 23 22:41:30.712635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 562/1143] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:31.199552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:31.200211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:31.207067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.207565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.208005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.208723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.209282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.209715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.292433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:31.294880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:31.301321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.302289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.302289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.302973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.303495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.303861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.339817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c2090b52-1358-4e28-b91f-37c7f935c77d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051602 Aug 23 22:41:31.340418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 563/1144] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:31.372069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:31.372922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:31.374089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:31.375281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7ccc3c87-e9bb-4c85-ad77-716b62f148c7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.180407 Aug 23 22:41:31.375854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 582/1145] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:31.769791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:31.772052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:31.778085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.778561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.778992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.779673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:31.780118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:31.780555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:31.810685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8491fcea-69fb-4003-b41d-5f793257eda4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089942 Aug 23 22:41:31.812803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 564/1146] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:32.352303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:32.355173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:32.361560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.362038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.362472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.363153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.363595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.364013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.393491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-95026887-3347-40bb-8b56-0f12c6b244b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Aug 23 22:41:32.394473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 583/1147] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:32.400173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:32.401036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:32.406972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.407470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.407901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.408594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.409071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.409505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.543051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:32.552368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:32.553955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:32.555268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ce3a2ee-d9e8-4fae-b89b-3bd6ed1fdd96 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159603 Aug 23 22:41:32.555828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 565/1148] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:32.825762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:32.827934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:32.833880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.834364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.834802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.836200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:32.836659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:32.837110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:32.866773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-58edfea5-a2cc-4101-a962-b4ca32c19e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Aug 23 22:41:32.867325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 584/1149] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:33.406551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:33.408825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:33.416070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.416559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.416999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.417719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.418175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.418601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.449947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-faf1962e-eb3c-4666-b404-26f2ecf535cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 Aug 23 22:41:33.450779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 566/1150] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:33.578426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:33.579031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:33.585606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.586233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.586668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.587353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.587802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.588220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.720966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:33.730571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:33.732055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:33.733238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f92f4c8-0f71-4e42-8b90-ba9e9b3b2492 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158947 Aug 23 22:41:33.733792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 585/1151] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:33.878355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:33.880561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:33.886845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.887335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.887774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.888468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:33.888962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:33.889410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:33.919635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c3a99beb-ddd4-4245-9cf3-0ef0cc4cf04a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Aug 23 22:41:33.920120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 567/1152] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:34.463481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:34.465711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:34.471767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.472247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.472833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.473553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.474005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.474433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.505705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-90ec421f-9842-42c2-827b-2e8454584de9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 23 22:41:34.506652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 586/1153] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:34.756493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:34.757117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:34.763043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.763525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.763959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.764655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.765135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.765558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.897269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:34.907073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:34.908579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:34.909775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a26ec58d-0f16-42b3-9ec9-43caceed0233 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157831 Aug 23 22:41:34.910393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 568/1154] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:34.931704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:34.933877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:34.940629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.941142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.941580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.942273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:34.942721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:34.943141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:34.974288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d8e31fc-4891-47ab-b320-63342b2b4ca2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Aug 23 22:41:34.974875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 587/1155] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:35.519128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:35.521423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:35.527907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.528392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.528829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:35.529583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.530039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.530464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:35.561836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f8f663d-dfda-4497-af21-66120fffefac tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046703 Aug 23 22:41:35.562420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 569/1156] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:35.934089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:35.934692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:35.940989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.941494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.941926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:35.942597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.943049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.943468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:35.986854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:35.989086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:35.996921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.997442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.997882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:35.998587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:35.999078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:35.999508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:36.029415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-09a9fa21-60d7-4037-bce8-e8322ce765b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046538 Aug 23 22:41:36.029988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 570/1157] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:36.077477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:36.079724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:36.087660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:36.099456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:36.099456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85056d03-fb43-4652-a961-77a9e6ed00ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160184 Aug 23 22:41:36.099456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 588/1158] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:36.574948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:36.577483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:36.583458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:36.583985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:36.584424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:36.585884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:36.586431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:36.586856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:36.617368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b3fa65f-3f41-439e-a0de-b4ee1888af76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Aug 23 22:41:36.618284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 571/1159] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:37.042318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:37.044509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:37.051561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.052054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.052559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.053282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.054294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.054944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.084170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1f10fa6a-4840-4fa0-97b0-0bfa61ad806b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Aug 23 22:41:37.084727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 589/1160] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:37.121314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:37.121931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:37.128317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.128798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.129261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.129973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.130426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.130849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.135326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:37.259125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:37.267945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:37.269556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:37.270720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e1bb061f-7d15-46e9-9be2-99b1d18d8973 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.153386 Aug 23 22:41:37.271279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 572/1161] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:37.629582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:37.631815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:37.638023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.638508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.638948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.639639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:37.640096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:37.640518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:37.672261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-945dd581-ad3b-471b-b564-de3109ea1173 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Aug 23 22:41:37.672843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 590/1162] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:38.096049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:38.098246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:38.106193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.106682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.107120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.107825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.108303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.109083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.138744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6cd2163-1b41-4738-856a-a48caa2288a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Aug 23 22:41:38.139388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 573/1163] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:38.293655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:38.294280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:38.300635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.301144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.301580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.302273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.302709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.303124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.431661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:38.440395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:38.441940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:38.443096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-965977ef-5659-4909-a556-03413abcc023 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.153349 Aug 23 22:41:38.443654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 591/1164] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:38.684551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:38.686883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:38.692858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.693378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.693811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.695132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:38.695581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:38.696005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:38.728855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8334b975-272c-495c-9ede-e5bc14ff048a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Aug 23 22:41:38.729635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 574/1165] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:39.151494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:39.153650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:39.159628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.160104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.160528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.161246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.161689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.162102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.191534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfe98d8c-7345-4a01-99d6-cdfbe47b5d0d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Aug 23 22:41:39.191795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 592/1166] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:39.466861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:39.467453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:39.474133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.474618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.475046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.476632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.477306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.477755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.618518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:39.627614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:39.629148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:39.630347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c8858bb1-e60a-40d3-8714-1546c6d3a177 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167457 Aug 23 22:41:39.630899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 575/1167] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:39.741994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:39.744391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:39.750904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.751397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.751828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.752526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:39.752976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:39.753419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:39.786970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0c5437df-b896-4d49-a59e-6b6ec17b1452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049632 Aug 23 22:41:39.787736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 593/1168] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:40.205038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:40.207167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:40.213477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.213966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.214384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.215072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.215512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.215926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.248183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9d4c6474-a33f-4065-aa9e-b6aa212fea91 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047152 Aug 23 22:41:40.248758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 576/1169] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:40.653810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:40.654445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:40.660540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.661060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.661509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.662216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.662666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.663118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.800266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:40.802512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:40.807131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:40.810495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.810986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.811893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.812107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:40.812554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:40.812975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:40.818646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:40.822165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:40.822379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c330c395-2376-48dd-8cad-2692d94bacbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.172705 Aug 23 22:41:40.822835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 594/1170] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:40 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:40.860537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8ea8272c-4ca0-499a-a0f3-b8b99ad97b52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064043 Aug 23 22:41:40.861492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 577/1171] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:41.260670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:41.262892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:41.269035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.269567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.269995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.270685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.271132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.271548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.302996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11810b05-de71-4f3c-8d09-2654b650cae2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Aug 23 22:41:41.304150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 595/1172] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:41.845656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:41.846206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:41.852614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.853133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.853575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.854264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.854718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.855143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.872750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:41.874908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:41.883593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.884070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.884497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.885222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:41.885672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:41.886086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:41.918635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d9049e8-b5a2-45cd-88ad-8a98dac59ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Aug 23 22:41:41.920892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 596/1173] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:41.997854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:42.007542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:42.008682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:42.009881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d10a3342-ecce-4baf-a46d-876db84c09ba tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168388 Aug 23 22:41:42.010435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 578/1174] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:42.316183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:42.318384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:42.325401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:42.325883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:42.326312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:42.327003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:42.327445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:42.327860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:42.358687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4c5ae14-a316-4028-8cbb-9e279236e69c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Aug 23 22:41:42.359262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 597/1175] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:42.932623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:42.934742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:42.940992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:42.941493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:42.941921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:42.942612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:42.943163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:42.943580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:42.976269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-edb94e99-6d68-48b4-8894-e1db8d4a585b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Aug 23 22:41:42.976827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 579/1176] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:43.033259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:43.033860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:43.041072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.041567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.042003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:43.042705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.043189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.043654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:43.179631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:43.188330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:43.189891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:43.191056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-43ad037a-b953-4bf7-9b02-9a5fc6eb6adf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161765 Aug 23 22:41:43.191614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 598/1177] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:43.372947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:43.375146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:43.381629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.381944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.382378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:43.383068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.383511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.383928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:43.413847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b954e585-9d8e-44ad-9abc-c4607c1139b2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 23 22:41:43.414396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 580/1178] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:43.987821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:43.989992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:43.997164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.997658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.998092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:43.998790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:43.999240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:43.999662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:44.031252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d41dd73f-044b-4324-89e8-fba3d21ead6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047338 Aug 23 22:41:44.031819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 599/1179] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:44.215031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:44.215655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:44.222149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:44.222629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:44.223057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:44.223741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:44.224244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:44.224624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:44.362715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:44.371638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:44.373243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:44.374440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e10c41a6-8423-4b6a-8e09-db8f60f68dd9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163442 Aug 23 22:41:44.376983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 581/1180] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:44.425491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:44.427680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:44.434334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:44.434818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:44.435255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:44.435955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:44.436467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:44.436822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:44.467039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-68f1f48a-6bdd-4ecb-81dc-e03d435f35a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Aug 23 22:41:44.467619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 600/1181] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:45.043665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:45.046076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:45.048247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=84 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:45.053153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.054131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.055987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.056718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.057198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.057625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.102483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4c3089fd-69c2-4c1e-99e2-858a62b48dd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062908 Aug 23 22:41:45.103076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 582/1182] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:45.397697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:45.398269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:45.404198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.404667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.405124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.405794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.406233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.406645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.479869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:45.482073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:45.488894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.489418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.489857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.490568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:45.491907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:45.492380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:45.524005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38ec926b-caa9-48a4-8176-54469dbf2fb9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048803 Aug 23 22:41:45.524620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 583/1183] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:45.538916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:45.547801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:45.549318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:45.550460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b3ab0175-c59c-4c77-92df-2c9c882b0f3c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156978 Aug 23 22:41:45.551012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 601/1184] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:46.114924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:46.117109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:46.123203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.123561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.123994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.124692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.125179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.125605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.159008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0cc2810b-a95a-4067-b222-302a9fc0703e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Aug 23 22:41:46.159575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 584/1185] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:46.536024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:46.538284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:46.540849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=84 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:46.545505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.546027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.546454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.547142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.547580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.547999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.576003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:46.576635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:46.579501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6ca4d04f-66c4-4079-99d5-cf4f5b425443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Aug 23 22:41:46.580136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 602/1186] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:46.583589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.584070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.584559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.585370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:46.585908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:46.586323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:46.729053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:46.737914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:46.739445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:46.740662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0fa75e8-f4a3-47b4-8550-415a90936b88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169105 Aug 23 22:41:46.741764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 585/1187] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:47.172357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:47.174570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:47.181737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.182248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.182687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.183440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.183896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.184313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.216123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dad413d7-c028-439f-9fdc-6ee4d4239aef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048207 Aug 23 22:41:47.216685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 603/1188] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:47.592325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:47.594532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:47.601336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.602213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.602664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.603362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.603817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.604246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.633365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2cc5e8ac-b590-4839-8701-fe2fa86ddbaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Aug 23 22:41:47.633923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 586/1189] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:47.769778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:47.770356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:47.777726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.778205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.778632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.779314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:47.779756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:47.780167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:47.915391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:47.924017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:47.925607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:47.926763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ad0ce11c-3608-4a0d-89aa-cefc2d800dfa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160893 Aug 23 22:41:47.927329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 604/1190] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:48.227673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:48.229910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:48.236518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.236897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.237359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:48.238078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.238678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.238973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:48.272135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ccb25d2a-cf2d-4c4e-aa5e-33de00d3aaae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048395 Aug 23 22:41:48.272790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 587/1191] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:48.646730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:48.649282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:48.658395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.658931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.659400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:48.660094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.660539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.660946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:48.676824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:48.693244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-851a4afa-ecdd-43e3-a8df-d270ba104eb0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051191 Aug 23 22:41:48.693818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 605/1192] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:48.950958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:48.951565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:48.957992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.958470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.958904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:48.959589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:48.960034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:48.960449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:49.102116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:49.104357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:49.111634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:49.113174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:49.114343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-66a83049-eb72-4272-89e6-6b65b3884ff8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168312 Aug 23 22:41:49.114904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 588/1193] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:49.373467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:49.376293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:49.382588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:49.383073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:49.383509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:49.384208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:49.385703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:49.386135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:49.419726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6de20375-3917-49d8-a444-ea3d299f5645 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138248 Aug 23 22:41:49.420307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 606/1194] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:49.706836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:49.709117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:49.716705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:49.717241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:49.717671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:49.718378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:49.718824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:49.719237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:49.750450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aca4d34a-622c-40db-9087-cf39d94d8426 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Aug 23 22:41:49.751072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 589/1195] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:50.138443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:50.139051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:50.145212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.145693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.146121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.146810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.147253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.147665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.286544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:50.296583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:50.298112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:50.299350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9d648472-50cb-4c60-970c-c9015611dc5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164834 Aug 23 22:41:50.300059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 607/1196] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:50.432237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:50.434377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:50.440963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.441579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.441927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.442650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.443107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.443533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.474314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-755596ee-2987-4032-a486-b04897ad1477 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Aug 23 22:41:50.474875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 590/1197] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:50.764528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:50.766812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:50.772852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.773372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.773811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.774499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:50.775212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:50.775765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:50.804881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1a8e29e4-2aa6-4fca-aa30-b0517b2717d7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Aug 23 22:41:50.805467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 608/1198] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:51.323599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:51.324211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:51.330483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.330965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.331399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.332087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.332536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.332958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.476489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:51.486674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:51.487141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:51.488316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:51.489418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:51.489603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8422c8d-064e-40eb-8cce-5143bb9ae828 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170462 Aug 23 22:41:51.490154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 591/1199] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:51 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:51.496789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.497297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.497725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.498413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.498856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.499268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.530627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c854941c-e89e-4ce5-82f4-358f0e5fa229 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Aug 23 22:41:51.531178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 609/1200] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:51.818144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:51.820340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:51.826783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.827268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.827707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.828399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:51.828853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:51.829308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:51.859042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-14a74e3e-93e7-4b4f-84b5-ca14ed3972df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Aug 23 22:41:51.859595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 592/1201] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:52.513906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:52.514506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:52.520858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.521363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.522070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.522488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.522930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.523340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.543318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:52.545631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:52.552173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.552706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.553175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.554326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.554788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.555859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.591331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e1faaaa8-1efc-4961-aa04-11eb3bf2247f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052296 Aug 23 22:41:52.592261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 593/1202] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:52.660340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:52.669837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:52.671366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:52.673165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-754d4913-5887-47ea-8c7a-333bf20187d4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163142 Aug 23 22:41:52.673495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 610/1203] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:52.871916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:52.874091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:52.879934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.880405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.880827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.881532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:52.881978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:52.882396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:52.913525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-41dadad9-524d-4118-81ed-bbacff4236a7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Aug 23 22:41:52.914062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 594/1204] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:53.606433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:53.608594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:53.615389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.615997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.616440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.617184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.617644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.618069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.648894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eef06864-f12f-46d3-a553-34c133c0bde5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Aug 23 22:41:53.649495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 611/1205] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:53.696720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:53.697498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:53.704232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.704716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.705183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.705869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.706316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.706729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.840207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:53.848923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:53.850460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:53.851635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b56041ae-4581-4e99-9559-2c1fa5fc21ec tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158922 Aug 23 22:41:53.852188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 595/1206] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:53.926687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:53.928822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:53.935557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.936039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.936475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.937205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:53.937656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:53.938081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:53.967975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71df93e1-8501-41f0-955d-cbf689608d01 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Aug 23 22:41:53.968550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 612/1207] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:54.660773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:54.662999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:54.669452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:54.669941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:54.670372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:54.671078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:54.671522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:54.671942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:54.703524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f9ce70b3-6bb8-4208-8887-cd0747e15662 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046653 Aug 23 22:41:54.704287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 596/1208] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:54.875787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:54.876395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:54.883414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:54.883904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:54.884341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:54.885089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:54.886103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:54.886558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:54.984435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:54.988198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:55.001134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:55.002029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:55.002709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:55.004610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:55.004735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:55.005456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:55.041536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5f17940f-3efc-47ce-ae8f-629ba36a8b6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064852 Aug 23 22:41:55.042137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 597/1209] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:55.051208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:55.061736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:55.063153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:55.064308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-020dfa04-bbd8-420c-a0b5-fcc2f6897fe4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.192531 Aug 23 22:41:55.064867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 613/1210] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:55.717036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:55.719238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:55.725860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:55.726349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:55.726779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:55.727481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:55.727932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:55.728355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:55.761381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-40be4080-c558-458f-8289-e5aa311ffe43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049139 Aug 23 22:41:55.762163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 598/1211] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:41:56.054126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:56.056379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:56.062767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.063256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.063693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.064388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.064840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.065291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.088763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:56.089896 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:56.095725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.096199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.096484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-845d2490-1eb2-43d3-8f68-7247a97ce8e3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046288 Aug 23 22:41:56.096654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.097251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 614/1212] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:56.097399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.097811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.098332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.232501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:56.241225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:56.242740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:56.243898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9527ad26-7afe-486c-b248-6a4fb322c6bf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159252 Aug 23 22:41:56.245036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 599/1213] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:41:56.774246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:56.778436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:56.784542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.785036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.785496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.786220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:56.787377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:56.787377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:56.817636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5b28608d-570f-4a71-a0fb-cfc16ea4e749 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Aug 23 22:41:56.818121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 615/1214] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:57.109731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:57.111874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:57.118497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.118986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.119923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.120869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.121460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.121971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.153453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-59049f37-7e37-418b-b621-2cc183dd1e96 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048127 Aug 23 22:41:57.154036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 600/1215] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:57.267663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:57.268281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:57.274784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.275269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.276214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.276923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.277403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.277832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.410246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:57.419832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:57.421376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:57.422545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4b0f506-2277-4a8e-bb15-5b88414e7bc7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158950 Aug 23 22:41:57.423103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 616/1216] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:57.830526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:57.832704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:57.839654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.840151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.840584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.841320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:57.841776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:57.842203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:57.875005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-85daeb91-f0a2-4d5c-bca0-887f8391cea2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Aug 23 22:41:57.875629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 601/1217] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:58.076028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:41:58.076247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:41:58.168943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:58.172984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:58.184546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.185535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.186344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.187687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.188525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.189352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.227396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31573495-c06e-474d-8b7c-f96d08782d7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065308 Aug 23 22:41:58.227881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 617/1218] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:58.445688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:58.446320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:58.453275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.453756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.454186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.454883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.455330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.455746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.607795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:58.617970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:58.619914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:58.621144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-46fb1f7e-622a-486f-a074-20893680fefe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.179409 Aug 23 22:41:58.621724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 602/1219] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:58.888163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:58.890474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:58.896949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.897469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.897915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.898614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:58.899199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:58.899630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:58.933220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bbfe6d2e-59ce-4d13-b393-7e94252bda80 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049093 Aug 23 22:41:58.933868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 618/1220] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:59.242735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:59.245679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:59.252416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.252907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.253496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:59.254257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.254710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.255125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:59.286842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-680e4d2e-4c75-41a8-beb0-8c37d9fb9f08 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050093 Aug 23 22:41:59.287402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 603/1221] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:41:59.645245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:59.645843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:59.653401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.654021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.654595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:59.655416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.656036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.656584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:59.796011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:59.805502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:59.807644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:41:59.808918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b9e1b5f-f0e5-4502-a3c8-14eecd189012 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167914 Aug 23 22:41:59.809556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 619/1222] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:41:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:41:59.947049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:41:59.950964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:41:59.959538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.960051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.960533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:41:59.961349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:41:59.961926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:41:59.962395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:00.000667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f2c37652-7bce-4124-bd8e-42b574c8ffc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058670 Aug 23 22:42:00.001508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 604/1223] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:41:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:00.299873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:00.302183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:00.308926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:00.309464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:00.309957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:00.310668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:00.311159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:00.311589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:00.348293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f47c497-3511-46c3-a2b1-4c50d55e524e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052669 Aug 23 22:42:00.348926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 620/1224] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:00.832189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:00.832706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:00.839093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:00.839843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:00.840389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:00.841164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:00.841619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:00.842041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:00.858605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:00.988948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:00.998437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:00.999934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:01.001145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-87f955d4-273e-45b5-a93c-28decc3124ac tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.173033 Aug 23 22:42:01.001704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 605/1225] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:01.015590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:01.018657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:01.036848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:01.036848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:01.036848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:01.036848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:01.037363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:01.037363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:01.064387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07cb45ce-f39e-49ac-aaf0-5f9483566c1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053792 Aug 23 22:42:01.064969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 621/1226] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:01.361178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:01.363375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:01.369599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:01.370086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:01.371177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:01.371888 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:01.372336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:01.372792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:01.403237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be47bea5-9e64-4ecc-99cf-942222767227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Aug 23 22:42:01.403817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 606/1227] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:02.028450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:02.029117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:02.035891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.036442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.036878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.037610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.038059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.038532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.041243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:02.078018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:02.080558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:02.091371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.091872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.092314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.093053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.093513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.093938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.142113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1d59896d-05f4-41bb-b570-5f9995dcb031 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067341 Aug 23 22:42:02.142113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 607/1228] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:02.212989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:02.224877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:02.226439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:02.227695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eddb5d98-c10d-4d7a-a433-f48060bca2f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.205091 Aug 23 22:42:02.228237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 622/1229] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:02.417967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:02.420369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:02.427213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.427750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.428236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.429077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:02.429645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:02.430177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:02.464553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9f016bab-4047-4c98-9eb4-3f44cb08c673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Aug 23 22:42:02.465281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 608/1230] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:03.155092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:03.162834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:03.165867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.165867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.166248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.167132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.168985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.168985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.212738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e299a144-8d27-4769-87fe-2195de17184c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062861 Aug 23 22:42:03.213978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 623/1231] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:03.254730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:03.255847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:03.264814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.265340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.265780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.266492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.266949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.267374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.407385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:03.416196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:03.418264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:03.419589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb8153f7-8793-4832-bd9a-3534cd4e9b91 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170592 Aug 23 22:42:03.420142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 609/1232] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:03.477441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:03.479624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:03.486768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.487264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.487711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.488412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:03.488867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:03.489325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:03.522245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ea5a64e6-14a7-47e4-8179-840b3c699b00 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048743 Aug 23 22:42:03.522917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 624/1233] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:04.227274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:04.230103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:04.238392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.239043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.239566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.240437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.241030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.241589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.274781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0050e5c9-7990-4cbf-83aa-b33754a41226 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052635 Aug 23 22:42:04.275461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 610/1234] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:04.448311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:04.449918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:04.456731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.457252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.457687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.458386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.458835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.459259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.537097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:04.539492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:04.548498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.549351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.550064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.551274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:04.552021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:04.552724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:04.587151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0ef828bd-66a3-4a12-8aa4-862e005d5611 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054954 Aug 23 22:42:04.587739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 611/1235] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:04.608468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:04.619056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:04.621338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:04.622675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-40e969ab-0830-4662-91de-0a5cba6faa8b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.178639 Aug 23 22:42:04.623300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 625/1236] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:05.288270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:05.290726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:05.298159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.298745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.299243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.300011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.300545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.300933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.335279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-db5eb2be-5700-457f-b0ff-555efd1e13ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051145 Aug 23 22:42:05.335850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 612/1237] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:05.600304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:05.602764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:05.610730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.611259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.611787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.612544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.613076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.613551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.647296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a4c701ee-045a-4979-8aa2-a1b0c15a8f0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051062 Aug 23 22:42:05.647912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 626/1238] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:05.650940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:05.651634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:05.659853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.660729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.661224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.662016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:05.662526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:05.662981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:05.809494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:05.819609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:05.822242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:05.822677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e82e86f3-47c2-4990-a6fa-deee0518fa51 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.176098 Aug 23 22:42:05.823333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 613/1239] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:06.349518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:06.353273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:06.361228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.361731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.362212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:06.362924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.363393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.363853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:06.396328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-117b146c-e4f3-4eca-9cc6-86b279398593 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051440 Aug 23 22:42:06.396911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 627/1240] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:06.660867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:06.663149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:06.671221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.671709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.672144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:06.672844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.673336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.673751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:06.706704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-694cc03c-dfe3-40ce-992a-ef348a652942 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049885 Aug 23 22:42:06.707299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 614/1241] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:06.848078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:06.848656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:06.855086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.855564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.855988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:06.856669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:06.857297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:06.857726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:07.005698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:07.016202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:07.017865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:07.019204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4af4b1b0-4699-46db-87b5-b3382a9a3261 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.175145 Aug 23 22:42:07.019790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 628/1242] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:07.410151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:07.412582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:07.419874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:07.420415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:07.420961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:07.421828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:07.422390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:07.422911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:07.455836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-123b12e1-82d5-4d55-be2d-2cb6b9426633 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050292 Aug 23 22:42:07.456401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 615/1243] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:07.719460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:07.721694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:07.728491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:07.729046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:07.729490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:07.730192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:07.730648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:07.731068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:07.763465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d5543c61-d0e3-4708-9e6e-5033459cddff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Aug 23 22:42:07.764038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 629/1244] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:08.043491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:08.044699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:08.051669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.052149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.052582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.053310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.053764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.054186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.196578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:08.206697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:08.208251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:08.209511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38fc4df6-1a07-4a08-85fc-ff3d43730786 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170125 Aug 23 22:42:08.210114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 616/1245] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:08.468759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:08.471186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:08.477905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.478382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.478820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.479514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.479968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.480391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.511733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9de78113-f5c3-4775-8ec9-58d608b4ef97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Aug 23 22:42:08.512322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 630/1246] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:08.776340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:08.779467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:08.785767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.786269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.786675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.787394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:08.787827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:08.788252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:08.820029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-13fd4c61-3118-49dc-83f6-b9d0cd0b01c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047879 Aug 23 22:42:08.820616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 617/1247] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:09.235005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:09.235570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:09.241784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.242275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.242710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.243426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.243879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.244300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.375759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:09.384448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:09.385970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:09.387126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-339098d4-70cd-42a8-994d-2bda66981903 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156220 Aug 23 22:42:09.387800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 631/1248] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:09.524667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:09.527285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:09.533846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.534332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.534763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.535453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.535901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.536325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.567660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ebf4e27-75b4-47b8-bbd7-b81b01d02785 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Aug 23 22:42:09.568199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 618/1249] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:09.838037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:09.840173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:09.847302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.847776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.848255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.848882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:09.849346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:09.849760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:09.880011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-37869032-5336-44d7-9c55-609685c90725 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Aug 23 22:42:09.880575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 632/1250] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:10.410192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:10.410792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:10.416846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.417358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.417793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.418503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.418982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.419806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.573142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:10.582666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:10.584394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:10.584923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:10.585383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7becb798-5feb-43fa-be21-d4027fea0760 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.179125 Aug 23 22:42:10.585933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 619/1251] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:10.587132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:10.594320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.594797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.595425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.596121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.596569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.596989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.627002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11c6274d-e2e1-4f99-82e9-e916d625f0a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045926 Aug 23 22:42:10.627559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 633/1252] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:10.892102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:10.894404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:10.900705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.901256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.901728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.902437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:10.902881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:10.903396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:10.936919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-320bda5a-d537-4112-b107-f0a51a8f0231 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048929 Aug 23 22:42:10.937536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 620/1253] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:11.608490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:11.609745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:11.625624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.625624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.625624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.625624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.625969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.625969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.640298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:11.642546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:11.651278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.651278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.651278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.651599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.651999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.652429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.687579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7ac8d5c5-296a-4b60-8e9a-2409cada95e6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051890 Aug 23 22:42:11.688156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 621/1254] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:11.757985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:11.767539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:11.768805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:11.770011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1cda2f38-4bf1-4daf-b3e6-44853b1622eb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166106 Aug 23 22:42:11.770575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 634/1255] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:11.949484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:11.951773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:11.957627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.958099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.958523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.959196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:11.959641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:11.960054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:11.963562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:11.991737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b1a0cfd9-506d-4d94-8789-ad1289114c1f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Aug 23 22:42:11.992398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 622/1256] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:12.699993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:12.702843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:12.709279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:12.709763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:12.710202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:12.710891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:12.711338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:12.711759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:12.740277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-64ec6163-9767-4347-b63b-d0d317515a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Aug 23 22:42:12.740829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 635/1257] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:12.795307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:12.795908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:12.806543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:12.807048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:12.809359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:12.810568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:12.811014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:12.811435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:12.947794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:12.958019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:12.959860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:12.961285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bdf8a653-ab60-4d2a-9c8a-ff7d0ba2638e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170427 Aug 23 22:42:12.962076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 623/1258] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:13.004298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:13.006483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:13.012349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.013518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.014053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:13.014744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.015195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.015617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:13.044699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85f09bae-db37-4032-b26a-b873a5747f87 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Aug 23 22:42:13.045283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 636/1259] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:13.752084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:13.754306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:13.760340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.760843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.761322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:13.762015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.762467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.762897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:13.793876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7a5b5437-22ee-4b5e-a6dc-98321e1a39d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Aug 23 22:42:13.794938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 624/1260] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:13.984763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:13.985456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:13.991899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.992384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.992823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:13.993558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:13.994013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:13.994440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:14.057283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:14.059703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:14.066241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:14.066817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:14.067286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:14.068064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:14.068597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:14.069283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:14.102514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fd3fc80e-9a95-40df-8835-7e24e4b948b5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049751 Aug 23 22:42:14.103361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 625/1261] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:14.126459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:14.135602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:14.137134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:14.138818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bc73fd29-d736-4fc3-a438-4ce36eaae8a9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158013 Aug 23 22:42:14.139371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 637/1262] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:14.807197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:14.809564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:14.816467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:14.816990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:14.817429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:14.818163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:14.818614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:14.819041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:14.850046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cc0df939-f2a1-4031-bb5e-aef24e57d98e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 23 22:42:14.850880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 626/1263] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:15.116674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:15.118797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:15.126123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.126808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.127424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.128216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.128854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.129336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.156451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:15.161454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8d980d8a-81ba-4043-82c9-c3582192c1a5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 Aug 23 22:42:15.162083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 638/1264] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:15.162407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:15.163029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:15.165433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=90 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:15.170966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.171449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.171883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.172619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.173291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.173715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.308082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:15.317376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:15.318955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:15.320172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-311dcabe-ca62-44aa-93c0-633a4b6f9002 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162069 Aug 23 22:42:15.320736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 627/1265] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:15.864538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:15.866877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:15.873708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.874194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.874633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.875328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:15.875784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:15.876210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:15.907551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85f0f667-a28b-4d62-8da9-93d9dfd23a1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 Aug 23 22:42:15.908266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 639/1266] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:16.174024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:16.176253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:16.183112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.183600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.184040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.184957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.185452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.185880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.215191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-654c19d5-931f-44b9-bd45-460ae41f2ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Aug 23 22:42:16.215818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 628/1267] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:16.345515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:16.346118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:16.352618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.353127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.353597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.354309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.354754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.355199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.492667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:16.502438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:16.503970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:16.505172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9846e319-b6a5-43db-bc50-a8272e3f38ca tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164523 Aug 23 22:42:16.505733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 640/1268] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:16.920641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:16.922797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:16.928835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.929347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.929777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.930464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:16.930912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:16.931326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:16.961384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3899cbe5-6bb2-4f6f-bc24-b68dbd0b3f83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Aug 23 22:42:16.961929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 629/1269] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:17.228605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:17.230853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:17.233388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:17.238199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.238689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.239126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:17.239850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.240304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.240751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:17.272266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19c64dd0-7875-400e-adbe-f0077608e140 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 Aug 23 22:42:17.272823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 641/1270] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:17.528437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:17.529647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:17.536216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.536701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.537176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:17.537878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.538334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.538759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:17.674958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:17.683563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:17.685476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:17.686626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-762cd111-8371-43b1-a034-7c43fb13bc5e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162264 Aug 23 22:42:17.687177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 630/1271] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:17.973867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:17.975986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:17.982648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.983131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.983601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:17.984273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:17.984715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:17.985164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:18.015583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-323e37a8-6a7b-4084-807f-0722749185aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Aug 23 22:42:18.016147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 642/1272] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:18.285690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:18.288243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:18.296481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:18.296974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:18.297684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:18.298391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:18.298902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:18.299333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:18.331178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-82761894-c12c-452f-86d9-0aba0f8a044e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049969 Aug 23 22:42:18.331742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 631/1273] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:18.709624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:18.710211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:18.716384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:18.716855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:18.717313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:18.718491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:18.718960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:18.719345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:18.849640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:18.859468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:18.860975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:18.862159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b900f979-0e6d-424d-aedc-77168820d656 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156459 Aug 23 22:42:18.862723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 643/1274] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:19.027863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:19.031181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:19.037351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.037885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.038422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:19.039122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.039578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.040005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:19.072016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-01c193a7-8ca9-41a5-9af1-f97c54e9cbef tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048098 Aug 23 22:42:19.072587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 632/1275] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:19.344138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:19.346313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:19.352727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.353250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.353683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:19.354360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.354803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.355219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:19.384400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0371f129-76c7-4198-a0a7-240383c82335 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 23 22:42:19.384958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 644/1276] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:19.886255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:19.887064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:19.893598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.894075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.894505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:19.895195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:19.895637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:19.896118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:20.030045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:20.040408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:20.042444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:20.043743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8ccf8c47-940c-4e44-b9bf-bd6aba637a94 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161463 Aug 23 22:42:20.044309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 633/1277] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:20.084853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:20.087233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:20.094311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:20.094810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:20.095283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:20.095987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:20.096450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:20.096875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:20.128854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b8dde21-0c64-4447-b99f-101edfdd7531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Aug 23 22:42:20.129453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 645/1278] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:20.396080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:20.398226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:20.404226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:20.404709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:20.405687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:20.406503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:20.406963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:20.407389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:20.437798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eaa86804-097a-4ec2-ba81-79cdc1d83703 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Aug 23 22:42:20.445206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 634/1279] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:21.067913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:21.068511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:21.078351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.078351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.078351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.078351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.078845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.079335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.141215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:21.143432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:21.149984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.150470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.150903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.151595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.152041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.152462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.186548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1d896270-3442-467e-8e96-3898d91b8fe9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Aug 23 22:42:21.187246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 635/1280] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:21.222145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:21.230977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:21.232473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:21.234386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fc23e5fd-ed1a-4e45-857b-9c1f4aa54da0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169692 Aug 23 22:42:21.234950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 646/1281] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:21.456836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:21.459343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:21.465358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.465843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.466286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.467066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:21.467515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:21.468557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:21.498881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8aaa763b-da75-4c3f-9e6f-7bc0dcad838e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Aug 23 22:42:21.499527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 636/1282] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:22.199678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:22.201925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:22.209000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.209508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.209940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.210705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.211154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.211572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.243344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-da66e68d-f5a7-4a4c-8d2f-1a3a275b08f2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048333 Aug 23 22:42:22.243903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 647/1283] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:22.258068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:22.258778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:22.265274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.265758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.266380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.267055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.267504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.267927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.398633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:22.407760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:22.409304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:22.410461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a79a60b5-7a62-4f71-8a20-9fda667c70ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156689 Aug 23 22:42:22.411023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 637/1284] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:22.511322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:22.513500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:22.519618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.520093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.520521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.521238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:22.521685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:22.522098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:22.551833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7e5b0414-b1a4-42c5-bedb-bef447e5cec9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 23 22:42:22.552397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 648/1285] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:23.256690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:23.259030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:23.265775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.266319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.267335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.268035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.268540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.268984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.294237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:23.300346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-394cd894-13fe-4ed2-994e-fab0bb382ae6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Aug 23 22:42:23.307429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 638/1286] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:23.434649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:23.435251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:23.442413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.442902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.443341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.444033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.444487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.444911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.564510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:23.566672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:23.573698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.574246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.574619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.574883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:23.575318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:23.575765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:23.576183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:23.584136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:23.585666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:23.586829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e1396839-e9de-41a1-8276-a963e5ec6a49 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156206 Aug 23 22:42:23.587389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 649/1287] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:23.605559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-67ed808d-892c-4570-aa9f-ec41f9f2fbf1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Aug 23 22:42:23.606109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 639/1288] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:24.318516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:24.320710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:24.326902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.327386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.327826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.328535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.329065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.329636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.359057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5060481-e853-465c-bb44-62566f73ada3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Aug 23 22:42:24.359608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 650/1289] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:24.610843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:24.611521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:24.616973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:24.618472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.619050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.619279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:24.619509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.620255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.620713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.621264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.625653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.626685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.627173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.627915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:24.628365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:24.628836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:24.661311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3d9b001-85e5-4838-8bee-7112a0b6e896 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Aug 23 22:42:24.661892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 651/1290] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:24.763506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:24.772901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:24.774497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:24.775650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f46f1c6-7828-4ccc-9f7b-88a8301351b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169278 Aug 23 22:42:24.776212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 640/1291] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:25.370960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:25.373118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:25.379614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.380100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.380536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.381248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.381696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.382130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.412248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf25c71a-15ba-48c3-88c8-a29d3292653d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Aug 23 22:42:25.412809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 652/1292] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:25.674951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:25.677126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:25.683810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.684293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.684855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.685633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.686078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.686522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.715582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e20f21df-8c29-4985-a52b-c83631f43ecf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Aug 23 22:42:25.716130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 641/1293] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:25.799195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:25.799809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:25.806223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.806755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.807202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.807900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:25.808354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:25.808830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:25.940163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:25.949037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:25.950534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:25.951673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-730f1fbf-de9e-4d9c-8d33-1c0382dfed26 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156613 Aug 23 22:42:25.952224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 653/1294] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:26.424210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:26.426470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:26.433361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.433898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.434402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:26.435120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.435584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.436007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:26.469834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bb71b5c6-b20b-4cac-898e-a0867c62be69 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Aug 23 22:42:26.470403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 642/1295] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:26.727944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:26.730173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:26.736110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.736593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.737037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:26.737727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.738171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.738631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:26.767123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9279aabb-46de-4b8d-90a3-2149962cb81f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Aug 23 22:42:26.768167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 654/1296] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:26.974525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:26.975135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:26.981612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.982097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.982533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:26.983229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:26.983680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:26.984105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:27.116939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:27.126002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:27.128372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:27.129604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2db53022-41ae-4e7d-aa0e-e3c34ed27bbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159183 Aug 23 22:42:27.130167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 643/1297] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:27.482451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:27.484684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:27.491917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:27.492402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:27.492840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:27.493586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:27.494038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:27.494460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:27.509164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:27.525123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-842d776f-abd9-4004-a4fa-dc898eb543d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Aug 23 22:42:27.526967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 655/1298] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:27.780443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:27.782623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:27.788861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:27.789419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:27.789857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:27.790548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:27.790996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:27.791414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:27.821406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-56d290a6-2754-4c0a-8686-98836a51bbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Aug 23 22:42:27.821966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 644/1299] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:28.154198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:28.154804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:28.160848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.161366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.161803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.162491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.162932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.163351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.308780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:28.319323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:28.321523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:28.322033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-68014a56-d130-4e8e-acc4-8235fd06be3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.172170 Aug 23 22:42:28.322644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 656/1300] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:28.538481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:28.540714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:28.548174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.549162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.549605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.550945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.551399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.551843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.584289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-86d96727-66ba-4ab1-b51d-d3be3730738d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050751 Aug 23 22:42:28.584860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 645/1301] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:28.834787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:28.836879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:28.843674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.844156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.844778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.845390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:28.845836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:28.846284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:28.879674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-198cb356-7a40-48b1-a45a-0eef9b7bfe16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049135 Aug 23 22:42:28.880242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 657/1302] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:29.345639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:29.346249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:29.352572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.353123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.353566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.354261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.354810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.355141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.490393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:29.499099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:29.500644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:29.501842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-191a6f93-71bf-400d-926f-2467ad58058b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160206 Aug 23 22:42:29.502402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 646/1303] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:29.596433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:29.598550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:29.604496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.604981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.605450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.606151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.606600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.607024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.637476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3933e37e-841e-4d52-b331-70ddb7000fcd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Aug 23 22:42:29.638036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 658/1304] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:29.892014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:29.894237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:29.900699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.901223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.901668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.902364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:29.902820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:29.903246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:29.933472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-73fb6571-a803-4f0f-8a81-0da3c54d117a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Aug 23 22:42:29.934040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 647/1305] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:30.526082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:30.526700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:30.532834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.533370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.533804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.534546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.534998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.535448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.650113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:30.652408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:30.658992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.659484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.659932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.660651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.661513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.661692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.677706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:30.687172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:30.688672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:30.689883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1fe718dd-676d-4ef7-b4ef-b8715f72d5a6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167783 Aug 23 22:42:30.690990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 659/1306] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:30.694229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a5c69464-3c0d-44ba-8906-9720ef27e641 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Aug 23 22:42:30.694795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 648/1307] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:30.946119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:30.948516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:30.954475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.954949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.955382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.956092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:30.956507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:30.957108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:30.985582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-88c83531-44e2-4c02-8db9-025d0eae107a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Aug 23 22:42:30.986119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 660/1308] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:31.706734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:31.709692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:31.714308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:31.714956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:31.716202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:31.716697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:31.717166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:31.717873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:31.718334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:31.718761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:31.721163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:31.721643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:31.722069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:31.722753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:31.723186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:31.724233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:31.750220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-00b71d01-719b-4728-905b-d8ed82158d65 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047403 Aug 23 22:42:31.750955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 649/1309] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:31.862075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:31.871078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:31.872580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:31.873778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-74d5f269-1c4e-4982-9903-4d06ac71707b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163303 Aug 23 22:42:31.874336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 661/1310] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:31.998569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:32.000729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:32.006729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.007211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.007647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:32.009046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.009524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.010005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:32.043373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dafecc2b-8af7-41f9-b193-a333ce694119 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Aug 23 22:42:32.043963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 650/1311] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:32.763012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:32.765147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:32.771539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.772029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.772444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:32.773148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.773612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.774008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:32.803081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8071edc7-cb69-4a90-9469-b75b15d5d21b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Aug 23 22:42:32.803626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 662/1312] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:32.897182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:32.897711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:32.904240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.904733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.905218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:32.905921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:32.906378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:32.906810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:33.044680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:33.054218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:33.054912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:33.056114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:33.057283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:33.062937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f4caaa77-9477-4b54-abb2-7c91ddcdedc8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164250 Aug 23 22:42:33.062937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 651/1313] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:33.063612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:33.064100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:33.064532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:33.065255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:33.065702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:33.066119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:33.096543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-363a445e-4fb2-44e7-a3af-2484c68f5c86 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Aug 23 22:42:33.097187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 663/1314] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:33.815919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:33.818065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:33.824468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:33.824950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:33.825406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:33.826090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:33.826534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:33.826973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:33.858747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0ecab26a-a1dc-4da4-8e15-81f1e31b0349 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Aug 23 22:42:33.859315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 652/1315] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:34.081620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:34.082252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:34.089206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.089684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.090114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.090803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.091247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.091687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.108996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:34.111449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:34.117990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.118493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.119417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.119634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.120087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.120512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.151834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ea6cce34-f296-41ff-97d1-5d7b869563cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Aug 23 22:42:34.152406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 653/1316] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:34.222726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:34.231459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:34.232951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:34.234152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-129bad53-66d9-44e7-b592-a207d5a15ee8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156554 Aug 23 22:42:34.234707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 664/1317] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:34.871617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:34.873907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:34.879915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.880399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.880833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.881560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:34.882014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:34.884133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:34.913548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a824a16-8e56-4b5e-8dca-e395a6ad76c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Aug 23 22:42:34.914113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 654/1318] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:35.164611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:35.166867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:35.173925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.174409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.174852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.175549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.176000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.176422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.207745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-09586665-5614-4805-b1e9-56a2e0239f10 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 Aug 23 22:42:35.208445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 665/1319] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:35.256535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:35.257171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:35.264582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.265089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.265524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.266220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.266666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.267082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.282649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:35.400530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:35.409855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:35.411341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:35.412494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b454900f-fa5c-438b-aa6b-87f247d2d6ea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159994 Aug 23 22:42:35.413059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 655/1320] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:35.926165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:35.928440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:35.935462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.935948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.936387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.937106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:35.937561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:35.937986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:35.967193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4bac3413-414e-4175-b6d3-349552a9224c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Aug 23 22:42:35.967806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 666/1321] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:36.222397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:36.224750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:36.231747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.232251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.232688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:36.233410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.233866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.234288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:36.265171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-630b6dd0-6751-44fd-8208-a701f25146cd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Aug 23 22:42:36.265838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 656/1322] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:36.436103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:36.436714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:36.446123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.446618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.447118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:36.448293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.448757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.449222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:36.583281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:36.594041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:36.595671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:36.596836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fca5cb8b-5090-4332-ac33-494979687c6a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164660 Aug 23 22:42:36.597492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 667/1323] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:36.979844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:36.982070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:36.988392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.988877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.989361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:36.990068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:36.990525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:36.991248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:37.025805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d0471be9-93b2-40d6-bd72-115d201592cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050043 Aug 23 22:42:37.026370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 657/1324] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:37.277998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:37.280142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:37.286129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:37.286614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:37.287048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:37.287735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:37.288188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:37.288610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:37.318983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a6ace557-890d-4506-9aa7-b4106bd0bbd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 23 22:42:37.319541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 668/1325] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:37.620784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:37.621522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:37.628502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:37.629036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:37.629491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:37.630242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:37.630701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:37.631181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:37.765166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:37.774450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:37.775970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:37.777178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2a03653b-0c36-4375-b9ce-82a45927ae1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161096 Aug 23 22:42:37.777734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 658/1326] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:42:38.038246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:38.040436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:38.047642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.047944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.048531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.049158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.049651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.050077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.081118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7816df8f-5f65-449c-bbfc-ec3bc3457021 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Aug 23 22:42:38.081686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 669/1327] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:38.331608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:38.333800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:38.340328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.340817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.341294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.341992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.342448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.342876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.373427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4f747ed7-fce8-4a3f-8205-ed8ecadbae70 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Aug 23 22:42:38.373998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 659/1328] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:38.799980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:38.800692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:38.807604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.808138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.808601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.809334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:38.809783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:38.810204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:38.944728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:38.954462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:38.956082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:38.957320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-416c6e38-5588-4e6a-9ac5-bb811096f451 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161373 Aug 23 22:42:38.957886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 670/1329] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:39.093721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:39.095863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:39.102816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.103296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.103725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:39.104409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.104859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.105298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:39.135810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ecd1a18c-a485-44cc-ae58-6818f44dd3a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046406 Aug 23 22:42:39.136374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 660/1330] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:39.386259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:39.388457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:39.394767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.395240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.395667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:39.396349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.396791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.397236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:39.425619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-84f00bcd-b4c9-49e1-ba6b-4ef0c665cc2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Aug 23 22:42:39.426162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 671/1331] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:39.980421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:39.981041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:39.987058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.987486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.987921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:39.988622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:39.989096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:39.989525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:40.122892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:40.132069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:40.134398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:40.135581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3234a49e-804f-491c-8953-548930694462 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159498 Aug 23 22:42:40.136133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 661/1332] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:40.147812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:40.150701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:40.156945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:40.157479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:40.157919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:40.158653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:40.159107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:40.159556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:40.162049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:40.190473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7171874-1b4a-4b9d-9fc1-447445385597 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Aug 23 22:42:40.191036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 672/1333] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:40.442862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:40.442862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:40.449522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:40.450017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:40.450460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:40.451188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:40.451645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:40.452071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:40.483457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-10f567a0-497e-40ff-be64-086e4ecb819b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Aug 23 22:42:40.484017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 662/1334] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:41.159841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:41.160447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:41.168029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.168588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.169035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.169724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.170169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.170584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.203820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:41.206022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:41.213599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.214094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.214534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.215354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.215827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.216326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.248771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d0c13471-da55-46f1-99bb-70a633f42091 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048589 Aug 23 22:42:41.249159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 663/1335] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:41.300174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:41.309128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:41.310641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:41.311782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19a914a5-8e60-412e-ac3b-ad9548cfe13a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156216 Aug 23 22:42:41.312329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 673/1336] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:41.496501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:41.498984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:41.504862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.505388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.505806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.506485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:41.506933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:41.507349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:41.537030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-81b553c5-bf9a-42f3-9e5e-9d1921b547a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Aug 23 22:42:41.537587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 664/1337] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:42.260769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:42.262945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:42.269379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.269866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.270308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.271000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.271457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.271881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.300739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4d44da97-a4eb-4752-a221-7a4e7a07b1d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 23 22:42:42.301326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 674/1338] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:42.335753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:42.336412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:42.342912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.343391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.343900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.344591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.345065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.345542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.487080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:42.498614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:42.500111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:42.501383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-af589716-3106-4c66-a97f-4f7097126191 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169561 Aug 23 22:42:42.501939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 665/1339] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:42.549366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:42.551469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:42.558091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.558091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.558429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.559636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:42.560092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:42.560515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:42.590397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-641831cd-31c3-4283-b2dd-3adb90294b89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Aug 23 22:42:42.590957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 675/1340] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:43.313225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:43.315354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:43.321939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.322679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.323208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.323891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.324337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.324752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.353445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e70ed0cb-ecb0-4c17-864b-a04cd9b38736 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Aug 23 22:42:43.354092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 666/1341] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:43.525435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:43.525985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:43.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.532933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.533400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.534525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.535241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.535673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.603528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:43.605920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:43.611932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.612416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.612848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.613567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:43.614013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:43.614426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:43.644626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-319fafe7-45fa-4d65-882b-67e458bc8b44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Aug 23 22:42:43.645098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 667/1342] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:43.674347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:43.683570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:43.685084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:43.687872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e072659e-bf22-4739-a7a4-64892177f079 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166632 Aug 23 22:42:43.689073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 676/1343] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:44.366069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:44.368270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:44.375156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.377535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.377535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.377535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.377535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.377941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.408224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-91580880-bb07-468d-a031-113dbae5a6b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Aug 23 22:42:44.408785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 668/1344] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:44.657607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:44.660139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:44.667158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.667665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.668093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.668793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.669275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.669699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.700408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-67a0efa4-0a5c-444c-89eb-656f5d5b6e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Aug 23 22:42:44.700974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 677/1345] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:44.714330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:44.714936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:44.720823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.721335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.721767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.722444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:44.722888 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:44.723305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:44.851717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:44.861421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:44.862940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:44.864163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1e5c7f31-75ec-48fd-aa96-2207a8a6f178 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.153810 Aug 23 22:42:44.864731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 669/1346] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:45.420665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:45.422825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:45.428676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.429188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.429622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:45.430300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.430749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.431161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:45.460637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ca2c02a5-0d80-46e5-ba1b-e206f3d3c8e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Aug 23 22:42:45.461216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 678/1347] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:45.711937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:45.714646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:45.717083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=86 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:45.721790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.722202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.722629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:45.723310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.723748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.724163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:45.755369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1fddf4c-f1fb-45dd-b19b-11b0fea366af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Aug 23 22:42:45.755959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 670/1348] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:45.888506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:45.889138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:45.895812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.896322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.896755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:45.897487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:45.897935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:45.898351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:46.029526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:46.038102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:46.039607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:46.041344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d0965213-aa33-4e37-9642-865fc64f7f1e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156862 Aug 23 22:42:46.041947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 679/1349] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:46.473936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:46.476122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:46.483153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:46.483649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:46.484091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:46.484827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:46.485393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:46.485827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:46.516248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5bb0ca2f-5697-4b1a-98b5-de1dc643d85f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Aug 23 22:42:46.516701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 671/1350] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:46.767947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:46.771904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:46.777101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:46.777592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:46.778030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:46.778721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:46.779173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:46.779658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:46.808558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8bf5559e-d585-4435-b0f5-2bd4e4d1b92f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Aug 23 22:42:46.809154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 680/1351] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:47.064766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:47.065349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:47.071456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.072003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.073409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.074111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.074599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.075026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.077807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:47.218332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:47.227516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:47.229571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:47.230757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b4133d49-f941-4e55-8279-9a5fa6e2f5b2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170049 Aug 23 22:42:47.231323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 672/1352] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:47.529519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:47.531680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:47.538062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.538547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.538984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.539671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.540118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.540545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.570009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ccf43d27-ae6b-4721-a2a4-39fc3eed29a8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Aug 23 22:42:47.570570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 681/1353] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:47.821083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:47.823615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:47.829626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.830111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.830545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.831355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:47.831686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:47.832107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:47.862006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be859c80-51a4-4d62-aa07-6710a29be773 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Aug 23 22:42:47.862586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 673/1354] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:48.254885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:48.255493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:48.257369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=82 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:48.263065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.263559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.269336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.269336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.269336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.269336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.397618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:48.406564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:48.408067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:48.409754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3fa794d7-f970-4f45-b254-5d6d88469b0a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158326 Aug 23 22:42:48.409978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 682/1355] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:48.583092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:48.585270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:48.592150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.592704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.606101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.606101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.606101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.606101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.627209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ecbd53ad-ccd6-4d5f-a0fe-b34c62700948 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Aug 23 22:42:48.627791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 674/1356] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:48.874353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:48.876653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:48.883647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.884142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.884650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.885406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:48.885858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:48.886284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:48.915532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6267be95-c0e9-49ac-8b64-fed66b64597a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Aug 23 22:42:48.916593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 683/1357] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:49.432366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:49.432977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:49.438931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.439468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.439883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.440575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.441051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.441484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.578835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:49.581496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:49.583221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:49.584475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d901585b-d3b1-4539-9da3-8b276bfeadbc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156263 Aug 23 22:42:49.585373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 675/1358] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:49.639833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:49.641989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:49.647905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.648447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.648824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.649538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.649985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.651021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.680884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d2e66811-b218-4e6c-8bbc-1d00baaf773a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Aug 23 22:42:49.681493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 684/1359] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:49.927857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:49.930112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:49.936866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.937389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.937831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.938599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:49.938978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:49.939402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:49.969476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bc551642-6d90-4940-b2a6-fa24a2ce5e75 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Aug 23 22:42:49.970049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 676/1360] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:50.610047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:50.610648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:50.617116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.617474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.617906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.618585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.619580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.620007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.694163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:50.696484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:50.704328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.704951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.705478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.706557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.707112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.707615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.740773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bcd6469c-1aa6-4664-ad47-4b7fa36d1a3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050504 Aug 23 22:42:50.745857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 677/1361] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:50.982493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:50.982803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:50.985148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:50.991327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:50.991767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.992258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.992697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.992852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:50.993434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:50.993889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:50.994596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-488450ed-c341-4786-b047-062536a829b8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.387851 Aug 23 22:42:50.994886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:50.995414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 685/1362] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:51.023949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b4b7053d-65e2-4b6e-b30a-a11c8069791e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 Aug 23 22:42:51.024502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 678/1363] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:51.753411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:51.755581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:51.762941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:51.763429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:51.763868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:51.764590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:51.765073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:51.765503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:51.795679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-89d4c419-79f3-4480-9957-aa12ef18c951 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Aug 23 22:42:51.796074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 686/1364] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:52.016834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:52.017465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:52.024479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.024957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.026045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.026782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.027190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.027606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.035707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:52.037882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:52.044427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.044910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.045377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.046066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.046510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.046931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.076987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-46b49f70-559c-4de7-9820-affc3c079ae1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Aug 23 22:42:52.077592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 687/1365] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:52.168701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:52.177805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:52.179350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:52.180506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bb1fec99-31e2-4d51-a5da-5066fa51dd05 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167645 Aug 23 22:42:52.181081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 679/1366] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:52.808301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:52.811819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:52.818456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.818941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.819377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.820108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:52.820565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:52.820991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:52.848314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:52.854067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-429b7407-a1d5-4054-9e5e-fb9a0427dc60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049918 Aug 23 22:42:52.854641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 688/1367] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:53.089871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:53.091972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:53.098441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.098919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.099347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.100029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.100478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.100966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.132975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dd9b0a3f-da42-4af6-b610-c2cced2162d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Aug 23 22:42:53.133566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 680/1368] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:53.196631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:42:53.197217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:42:53.207332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:53.208357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:53.216500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.216986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.217526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.218231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.218684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.219111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.352530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:53.361488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:53.363001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:53.364170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1b33e316-358d-4f44-99ce-0848a70840c3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161922 Aug 23 22:42:53.364746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 689/1369] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:53.873868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:53.876018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:53.882021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.882498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.882927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.883613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:53.884057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:53.885145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:53.915347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f46a974c-c2a1-4434-ae14-ef0385520503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Aug 23 22:42:53.916051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 681/1370] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:54.144983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:54.147086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:54.153644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.154124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.154561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.155250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.155694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.156340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.186130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6b9fdbf1-1876-48d9-a891-a35d03a8310e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Aug 23 22:42:54.186691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 690/1371] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:54.387366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:54.387985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:54.394637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.405741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.405741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.405741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.405741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.406168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.535418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:54.546025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:54.547639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:54.548853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c6f4f2fb-b5f9-4b2e-9e93-d820b23840e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.165872 Aug 23 22:42:54.549437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 682/1372] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:54.927073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:54.929377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:54.935551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.936037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.936474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.937202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:54.937658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:54.938078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:54.970723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-16dd3fa6-981d-4d98-9bdc-2081955b5f3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047552 Aug 23 22:42:54.971369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 691/1373] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:55.199876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:55.203065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:55.209568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.210164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.210712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:55.211422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.211876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.212307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:55.243185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3690604a-1611-46c4-afbe-834cf20b18ba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048313 Aug 23 22:42:55.244291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 683/1374] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:55.574264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:55.574882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:55.581295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.581779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.582216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:55.582903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.583351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.583772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:55.718988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:55.727638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:55.729693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:55.730917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-82599fa7-c520-4813-aec1-5e9af105113d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161338 Aug 23 22:42:55.731481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 692/1375] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:55.983841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:55.986014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:55.992365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.992842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.993304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:55.993993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:55.994468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:55.994884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:56.023835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f70e75f9-2fca-4be1-b1fc-3aeba6811539 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Aug 23 22:42:56.024389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 684/1376] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:56.256246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:56.258446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:56.264662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:56.265202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:56.265647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:56.266370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:56.266822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:56.267246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:56.297478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3799520-df73-4e29-9e64-1c218fc0b7f9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Aug 23 22:42:56.298131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 693/1377] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:56.755234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:56.755846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:56.763200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:56.763721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:56.764147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:56.764838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:56.765357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:56.765942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:56.900030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:56.909417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:56.910937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:56.912122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-193bd697-0bea-4c47-8f72-de530a90a890 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160926 Aug 23 22:42:56.912663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 685/1378] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:57.037638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:57.039806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:57.046500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.046982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.047418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:57.048111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.048560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.048981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:57.080061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5e0c15ff-8e40-4971-94a4-078a7fe1729a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Aug 23 22:42:57.080616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 694/1379] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:57.309790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:57.311936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:57.318358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.318832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.319260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:57.319944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.320391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.320806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:57.350529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c918fd39-0152-4a3b-864a-52fd599da224 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Aug 23 22:42:57.351080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 686/1380] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:57.936159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:57.936680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:57.942627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.943107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.943552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:57.944225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:57.944674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:57.945123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:58.086491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:58.092373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:58.094530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:58.096689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:58.098339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:58.099720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34a49541-3235-4ae2-a7ee-bd19f9de68bb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168061 Aug 23 22:42:58.100229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 695/1381] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:58.100430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:58.100919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:58.101511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:58.102219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:58.102654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:58.103071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:58.134387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ba8f740d-7769-4594-8043-d406f8ead012 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Aug 23 22:42:58.134989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 687/1382] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:58.362927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:58.365111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:58.371263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:58.371729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:58.372174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:58.372872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:58.373349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:58.373775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:58.403632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fbb39843-42c9-4dff-82a7-2662db2d226d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 23 22:42:58.404196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 696/1383] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:42:59.124203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:59.124846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:59.131788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.132271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.132726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.133518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.134016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.134483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.146712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:59.148884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:59.155753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.156232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.156681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.157386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.157829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.158349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.194248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9467027e-0475-461c-b8ae-473720d9bb9e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051428 Aug 23 22:42:59.194823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 697/1384] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:42:59.280203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:59.282559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:59.292321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:59.308811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:42:59.308811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-13740dce-8cda-4f23-a7ec-cd9a29a53e7d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.175749 Aug 23 22:42:59.308811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 688/1385] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:42:59 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:42:59.415971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:42:59.418712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:42:59.424861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.425380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.425889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.426522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:42:59.426971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:42:59.427400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:42:59.459764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f7cfc54a-705e-4326-b337-6510b3b12852 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Aug 23 22:42:59.460317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 698/1386] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:42:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:00.207562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:00.209736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:00.217367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.217846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.218298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.218990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.219433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.219851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.250955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-745b8e57-45ab-4759-9c7b-bbf7ef49ef4f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Aug 23 22:43:00.251515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 689/1387] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:00.330748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:00.331291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:00.337591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.338070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.338500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.339751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.340316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.340743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.472179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:00.472617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:00.474458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:00.481085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.481684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.482171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.482459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:00.482911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:00.483374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:00.483806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:00.483953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:00.485145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7b608c7c-12db-4137-b9b1-356790428010 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158409 Aug 23 22:43:00.495486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 699/1388] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:00.517693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-861b3a0f-5515-4cc4-817e-70d34a148b92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049690 Aug 23 22:43:00.518250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 690/1389] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:01.262799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:01.264945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:01.271013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.271496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.271932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.272630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.273113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.273541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.305703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-44feea79-c60c-4bc0-92ad-e08fd2feea3a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046953 Aug 23 22:43:01.306268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 700/1390] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:01.509047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:01.509643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:01.516840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.517368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.517808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.518504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.518955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.519381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.531588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:01.533749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:01.540223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.540846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.541320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.542231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:01.542800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:01.543234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:01.575610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26a25da9-254e-43dc-a6b7-fe09fa53f25f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048292 Aug 23 22:43:01.576186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 701/1391] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:01.653084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:01.662033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:01.663537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:01.664701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-90eb45c4-e2e9-47ec-913e-185ccad55254 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159670 Aug 23 22:43:01.665288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 691/1392] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:02.318237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:02.320316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:02.326894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.327403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.327860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.328554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.329353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.329777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.360536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b04fb91b-396a-4cb6-ac92-c2bdadce2884 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Aug 23 22:43:02.361181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 702/1393] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:02.587992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:02.590634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:02.597187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.597671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.598106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.598802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.599247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.599700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.629797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e9b14c0f-138c-434e-b053-0dedfa302354 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Aug 23 22:43:02.630352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 692/1394] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:02.687508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:02.688104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:02.694614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.695079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.695505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.696180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:02.696891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:02.697335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:02.826971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:02.835586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:02.837114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:02.838329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f516ffd0-b807-4fa9-8a1a-2204d07e346c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.154688 Aug 23 22:43:02.839321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 703/1395] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:03.373443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:03.375581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:03.381487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.381966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.382394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:03.383075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.383517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.383933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:03.414131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9f646884-623b-45d7-b0cc-56e15c542eaf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Aug 23 22:43:03.414683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 693/1396] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:03.642785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:03.644938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:03.651072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.651598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.652080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:03.652759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.653230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.653656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:03.688232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f2698cb9-17cd-48b0-8b8e-260404c6c4fc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049381 Aug 23 22:43:03.688882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 704/1397] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:03.862089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:03.862610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:03.869002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.869540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.869949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:03.871359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:03.871810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:03.872239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:04.007659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:04.016835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:04.018392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:04.019545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4c46ee48-c6c6-4264-81ef-75062f304b17 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161547 Aug 23 22:43:04.020098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 694/1398] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:04.426741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:04.428909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:04.435785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:04.436274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:04.436717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:04.437436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:04.437892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:04.438317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:04.453537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:04.470277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-67496899-460d-4ea0-b46f-8a13b02ff0aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 Aug 23 22:43:04.470830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 705/1399] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:04.700783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:04.703031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:04.709880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:04.710467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:04.711004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:04.711854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:04.712339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:04.712866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:04.743474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bc232244-8289-4942-99d4-2eaa2937795b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047277 Aug 23 22:43:04.744036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 695/1400] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:05.042198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:05.043499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:05.050376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.050888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.051335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.052186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.052494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.052924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.190598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:05.200086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:05.201601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:05.202807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d975987b-db28-4417-97d3-e53a2a2a7503 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164593 Aug 23 22:43:05.203361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 706/1401] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:05.483011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:05.485240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:05.492001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.492529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.492968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.493706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.494164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.494592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.525291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce674861-8450-4471-8bb4-8e3b5cb2d286 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Aug 23 22:43:05.525848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 696/1402] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:05.756556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:05.758868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:05.766653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.767143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.767586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.768288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:05.768741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:05.769205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:05.803500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3f8bd1d-5684-4c45-813f-2d304d1df80c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051141 Aug 23 22:43:05.804126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 707/1403] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:06.226705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:06.227419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:06.233944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.234431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.234948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.235729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.236186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.236612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.369459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:06.378755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:06.380268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:06.381468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4cad8358-11e1-450f-8061-7608963ef5d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159147 Aug 23 22:43:06.382030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 697/1404] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:06.538950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:06.541032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:06.547096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.547581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.548018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.548709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.549196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.549624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.580675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d31c6907-b4d3-4d7e-80b0-000912fb8d60 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 23 22:43:06.581280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 708/1405] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:06.818103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:06.820147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:06.826472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.826920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.827352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.828112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:06.828564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:06.828986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:06.858904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-020a2ded-ef4f-4464-8363-e9d5eb923445 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Aug 23 22:43:06.859488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 698/1406] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:07.405145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:07.405754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:07.412257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.412747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.413218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.413913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.414420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.414815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.550585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:07.560287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:07.561838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:07.562999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-57520877-6952-4550-9193-1ab70946ac2c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162119 Aug 23 22:43:07.563551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 709/1407] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:07.592966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:07.595227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:07.601133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.601609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.602039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.602718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.603170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.603587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.640358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f52304de-d445-45f5-b651-da871ee46452 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051349 Aug 23 22:43:07.640924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 699/1408] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:07.871845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:07.874260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:07.880417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.880906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.881380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.882076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:07.882557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:07.882979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:07.912885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5dbc13f-aa85-444d-8f2b-02669723136c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Aug 23 22:43:07.913468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 710/1409] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:08.244597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:43:08.245186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:43:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:43:08.586367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:08.586984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:08.594886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.595364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.595827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.596516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.596961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.597402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.654639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:08.658122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:08.669859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.671016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.671555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.672461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.672889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.673507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.716361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9320fecc-ed26-47d6-812f-1ac1abfbd5a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066554 Aug 23 22:43:08.717240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 711/1410] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:08.815740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:08.827927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:08.829485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:08.830682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dff810c9-d201-4731-a2f6-42f3aa214043 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.248697 Aug 23 22:43:08.831275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 700/1411] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:08.926209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:08.928426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:08.935496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.935975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.936439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.937180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:08.937659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:08.938073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:08.970513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a03f33db-32fd-48dc-a0c3-9368ae371dcf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048962 Aug 23 22:43:08.971098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 712/1412] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:09.729946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:09.731802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:09.738278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.738764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.739203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.739902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.740356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.740780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.772075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e381232f-924f-49c8-8051-2d6bccd0bd71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046753 Aug 23 22:43:09.772645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 701/1413] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:09.855372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:09.856032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:09.862731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.863212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.863654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.864346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.864797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.865276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.983351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:09.985551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:09.991799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.992290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.992777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.993460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:09.993909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:09.994405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:09.998411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:10.008184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:10.009727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:10.010965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07d3fd65-4dcf-4843-8012-3d9093498537 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160322 Aug 23 22:43:10.012482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 713/1414] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:10.025678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-12ca406d-06ec-4215-b503-ce71dcaf1eb8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Aug 23 22:43:10.026180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 702/1415] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:10.784603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:10.786815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:10.793441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:10.793924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:10.794367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:10.795064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:10.795516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:10.795974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:10.830508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-808bbd36-a53c-4b16-9b94-fc96d2a5bfb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049864 Aug 23 22:43:10.831392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 714/1416] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:11.034714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:11.035497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:11.038818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:11.041161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:11.042923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.043528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.044161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.045478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.045990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.046460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.048282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.048802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.049549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.050320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.052368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.053412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.085242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-501f4153-677e-4cad-bb45-79fbf73ad7a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050932 Aug 23 22:43:11.085832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 715/1417] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:11.181451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:11.191120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:11.192615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:11.193790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fffaf0a6-f063-4389-9d19-46cfb18d4109 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163409 Aug 23 22:43:11.194340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 703/1418] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:11.843413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:11.845542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:11.851523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.852103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.852442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.853174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:11.853636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:11.854057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:11.888368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3dec2f51-62b5-4ac3-b02d-cff9ffaff963 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049089 Aug 23 22:43:11.888965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 716/1419] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:12.098972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:12.101110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:12.108704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.109213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.109675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.110387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.110842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.111269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.144387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9bd276b4-97b1-493f-9067-9feccf7eb3da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049511 Aug 23 22:43:12.144959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 704/1420] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:12.219365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:12.219999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:12.227050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.227607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.228040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.228726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.229200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.229614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.383564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:12.394189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:12.395937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:12.397320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26cbbd77-c241-4a96-94f6-a695a961439f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.181942 Aug 23 22:43:12.397894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 717/1421] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:12 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:12.900631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:12.902844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:12.909073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.909560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.910014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.910686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:12.911160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:12.911560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:12.925510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:12.941726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ec0ff7fa-6fd6-4e98-99b9-0268a0cae33e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 23 22:43:12.942321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 705/1422] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:13.158489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:13.160652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:13.166866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.167922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.168356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.169084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.169532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.169958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.201700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8734c760-b533-449d-a266-2e77ad3da359 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 23 22:43:13.202271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 718/1423] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:13.428662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:13.429216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:13.436787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.437297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.437732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.438417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.438867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.439283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.577150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:13.586202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:13.587716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:13.588919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8f12597d-fdec-4fc5-a843-2713660d5d82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164297 Aug 23 22:43:13.590279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 706/1424] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:13.954905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:13.957190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:13.963976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.965042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.965544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.966353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:13.966750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:13.967177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:13.998348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2306617a-6d12-4113-8dc6-9b36406b039b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Aug 23 22:43:13.998928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 719/1425] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:14.215302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:14.217703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:14.224236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:14.224766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:14.225238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:14.226014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:14.226465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:14.226890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:14.256135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-134b17c5-ffd3-4c05-a99e-271d70d400c7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Aug 23 22:43:14.256685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 707/1426] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:14.612159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:14.612763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:14.618940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:14.619420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:14.619858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:14.621228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:14.621693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:14.622203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:14.769726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:14.778576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:14.780082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:14.781277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7e904f31-9445-48c0-873b-d6f8d888383c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.173092 Aug 23 22:43:14.781837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 720/1427] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:15.011595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:15.013821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:15.020099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.020582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.021039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.021894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.022344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.022762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.058137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e97fb7b-c4a1-4e5b-862d-0bdb14fc35d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051000 Aug 23 22:43:15.058521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 708/1428] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:15.269113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:15.271284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:15.277934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.278427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.278863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.279567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.280014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.280436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.313509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-620453d0-7e62-4cd9-ab4e-adc862bd285b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Aug 23 22:43:15.314102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 721/1429] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:15.804791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:15.805472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:15.812251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.812695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.813224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.813977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:15.814482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:15.814934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:15.957703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:15.966925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:15.968516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:15.969642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b713befc-aa99-4776-8332-7c3380b31d15 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168806 Aug 23 22:43:15.970183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 709/1430] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:16.071291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:16.074060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:16.080810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:16.081339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:16.081780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:16.082476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:16.082930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:16.083361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:16.085864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:16.117434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e0888fc3-1ad6-4b74-ad01-4bfca3aaddc6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Aug 23 22:43:16.118053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 722/1431] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:16.327956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:16.330185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:16.336765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:16.337286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:16.337723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:16.338412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:16.339019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:16.339962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:16.369798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7e6ea834-324f-47fd-9393-b01c60e0656b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Aug 23 22:43:16.370554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 710/1432] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:16.994405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:16.994997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:17.001632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.002113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.002548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.003257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.003717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.004138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.130679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:17.133021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:17.135145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=82 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:17.136914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:17.140628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.141280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.141839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.142597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.143139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.143707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.146334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:17.147991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:17.149206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-af403fe3-8d3d-47b1-a088-be1ea7c8fd8a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158858 Aug 23 22:43:17.155934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 723/1433] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:17.177534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ab56f6cc-cf90-4237-af60-a0fab2d2b5e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Aug 23 22:43:17.178346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 711/1434] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:17.382595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:17.384739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:17.391402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.391881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.392314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.393034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:17.393458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:17.393870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:17.424240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e806f844-8d2f-4932-881c-383e237cb085 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Aug 23 22:43:17.424797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 724/1435] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:18.175801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:18.176439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:18.183274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.183756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.184197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.184980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.185464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.186063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.189854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:18.192199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:18.199028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.199510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.199954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.200768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.201257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.201677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.235171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d15f8c2f-55ff-480e-8af4-ca3a2609be11 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049171 Aug 23 22:43:18.235754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 725/1436] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:18.318274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:18.326976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:18.328464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:18.329684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-40155982-7141-41d5-9a44-39162d6f8226 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157880 Aug 23 22:43:18.330229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 712/1437] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:18 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:18.439569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:18.441789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:18.443601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=88 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:18.448470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.448949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.449419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.450466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:18.450923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:18.451351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:18.482306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e173f649-a75b-4108-8378-e984a3c4a310 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046749 Aug 23 22:43:18.482878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 726/1438] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:19.248157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:19.250349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:19.256990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.257504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.259393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.259393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.259393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.259806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.290762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3873ebb8-9d3a-43e9-ba7f-c92218b598fb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Aug 23 22:43:19.291318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 713/1439] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:19.353728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:19.354277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:19.361647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.362172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.362586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.363256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.363699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.364120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.495939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:19.498407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:19.504761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.505406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.505996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.506738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:19.507190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:19.507616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:19.507728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:19.517106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:19.518614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:19.519814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2416e821-95c7-4716-b526-1ad6ddcb5591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170276 Aug 23 22:43:19.520405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 727/1440] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:19.538327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dbd2b664-41a8-4d87-9198-e80ecfe13ac8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Aug 23 22:43:19.538891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 714/1441] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:20.303961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:20.306203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:20.313038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.313532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.313972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.314669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.315116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.315542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.346500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-64958e11-2666-48e2-a119-3d1e18333e5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Aug 23 22:43:20.347094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 728/1442] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:20.542527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:20.543130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:20.550079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.550571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.550851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:20.551343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.551694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.552148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.552573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.553041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:20.559810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.560301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.560765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.561495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:20.561945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:20.562368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:20.593922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f42af946-d564-4643-9fed-54ca69321ffd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Aug 23 22:43:20.595002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 729/1443] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:20.934681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:20.944579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:20.946628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:20.947940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f2e5dbcd-f03a-49d8-9b78-b4fd34542c87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.409333 Aug 23 22:43:20.948497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 715/1444] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:21.359658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:21.361933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:21.368012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.368500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.368944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:21.369673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.370132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.370559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:21.401327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1e13a21c-1583-4335-b4c6-d19681f3a5d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Aug 23 22:43:21.401889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 730/1445] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:21.606407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:21.609471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:21.616259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.616744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.617212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:21.617909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.618365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.618790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:21.648686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e37eaa2c-ea4a-4347-86b4-f438bdf1f7da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Aug 23 22:43:21.649288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 716/1446] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:21.972915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:21.973573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:21.979990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.980470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.980901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:21.981624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:21.982070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:21.983172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:22.112078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:22.120775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:22.122316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:22.123637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ff90b733-576c-43d5-8200-d5ca7f4f6725 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.154515 Aug 23 22:43:22.124190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 731/1447] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:22.414049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:22.416189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:22.422543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:22.423018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:22.423443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:22.424122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:22.424564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:22.424983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:22.455722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4ee7de49-5493-4419-b2ed-0ee466ccbb42 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 23 22:43:22.456289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 717/1448] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:22.660771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:22.663036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:22.669168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:22.669654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:22.670183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:22.670847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:22.671296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:22.671737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:22.702409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ba6b2cf5-ced0-4e01-8e6a-6fbc44821b0a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Aug 23 22:43:22.702963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 732/1449] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:23.146226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:23.147043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:23.153331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.153807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.154688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.155384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.155824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.156241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.287465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:23.296442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:23.297997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:23.299171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8e4e9291-398a-40b2-a760-91f24d9f46b4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156921 Aug 23 22:43:23.299730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 718/1450] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:23.468638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:23.470861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:23.477375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.477862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.478300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.478995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.479448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.479882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.511313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b6eda0cf-04e0-4b45-a4e4-1e206426dd43 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046709 Aug 23 22:43:23.511889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 733/1451] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:23.714913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:23.717125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:23.723489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.723909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.724351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.725080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:23.725545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:23.725969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:23.758724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-585f2805-8553-4d8e-9864-9257169a4850 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Aug 23 22:43:23.759296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 719/1452] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:24.323766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:24.323766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:24.330658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.331142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.331569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.332261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.332708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.333160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.469859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:24.479202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:24.480703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:24.481884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2b8c117-3879-484d-afae-7ed9954cb4dd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163138 Aug 23 22:43:24.482471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 734/1453] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:24.526006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:24.528203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:24.535750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.536291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.536909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.537625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.538078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.538504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.575019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-42509aa1-e1a8-43e4-93be-4bd5fcfcd063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052974 Aug 23 22:43:24.575648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 720/1454] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:24.771368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:24.773642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:24.779888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.780398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.780895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.781784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:24.782244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:24.782676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:24.813507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19db664a-b547-4d41-9bb8-ffc709f915d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Aug 23 22:43:24.814065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 735/1455] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:25.504070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:25.504670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:25.511185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.511726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.512195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.513414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.513540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.513936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.588031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:25.590459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:25.598329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.598846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.599285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.599992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.600444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.600870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.633424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ba0a0456-81c2-4b21-8785-638cc34d3987 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049258 Aug 23 22:43:25.633919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 736/1456] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:25.649632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:25.659150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:25.660652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:25.661868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4954bb7-cdad-4b12-a6a5-938d8bf4e89f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162129 Aug 23 22:43:25.662422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 721/1457] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:25 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:25.825594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:25.827745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:25.834216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.834697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.835132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.835819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:25.836267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:25.836688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:25.868467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4923c153-eff4-466d-ae9a-752761765954 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Aug 23 22:43:25.869110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 737/1458] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:26.646069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:26.648229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:26.655009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.662278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.662278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.662278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.662278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.662745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.662745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:26.693634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:26.693634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:26.694263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3cb30784-d8db-4674-a803-53c626835639 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Aug 23 22:43:26.694263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 722/1459] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:26.695928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.696410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.696845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.697549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.697996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.698409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.829691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:26.832021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:26.839217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:26.840713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:26.841917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3c87ca34-3b06-47ca-92c8-8da7ee53bc0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157918 Aug 23 22:43:26.842473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 738/1460] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:26.881465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:26.883761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:26.890336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.890825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.891268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.891961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:26.892420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:26.892849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:26.923075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a732af55-3147-48ff-b99f-0b33b7e78d02 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Aug 23 22:43:26.923638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 723/1461] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:27.702973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:27.705251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:27.712772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.719498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.719498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.719498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.719498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.719935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.744594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6205f96a-4a00-4cd3-9f05-c5bce9a4df44 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Aug 23 22:43:27.745080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 739/1462] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:27.866854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:27.867459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:27.873672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.874216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.874683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.875384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.875841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.876267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.935973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:27.938307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:27.945194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.945935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.946374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.947076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:27.947522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:27.947942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:27.980581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e3f25cb5-76d3-4689-b6c8-8b4239cd4a44 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048583 Aug 23 22:43:27.981174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 740/1463] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:28.011423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:28.021195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:28.022737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:28.023937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c3753d94-c325-4ae2-8f55-c2cdab5136e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162151 Aug 23 22:43:28.024528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 724/1464] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:27 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:28.757636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:28.759879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:28.766793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:28.767393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:28.768192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:28.769939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:28.770772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:28.771551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:28.804218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-edb38df1-f698-4bab-9e18-bd7f366fbcd5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050708 Aug 23 22:43:28.804800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 741/1465] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:28.993257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:28.995387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:29.002033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.002539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.003464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.004344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.004796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.005245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.034532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e2607d50-b75a-434a-abcd-ea2513cc3502 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 23 22:43:29.035091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 725/1466] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:29.046595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:29.047197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:29.053706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.054183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.054672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.055303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.055750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.056167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.194990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:29.203881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:29.205412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:29.207182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f259df1-a7be-47a0-9299-d4da25d9ae3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164408 Aug 23 22:43:29.207734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 742/1467] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:29.817544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:29.819612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:29.825903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.826387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.826819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.827514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:29.827967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:29.828387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:29.860055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3dc56b28-8af8-41ab-82f0-a1aa029fb87a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047331 Aug 23 22:43:29.860607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 726/1468] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:30.046700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:30.048921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:30.055839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.056325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.056764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.057497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.057953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.058379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.088676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a60f0c85-ef46-4918-83ad-32c264b6d8dd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 23 22:43:30.089182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 743/1469] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:30.231838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:30.232507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:30.239178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.239665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.240101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.240804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.241290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.241725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.375600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:30.384913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:30.386537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:30.387824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c19ae38a-14ca-47aa-80c0-5c5541781f80 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159999 Aug 23 22:43:30.388816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 727/1470] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:30.872588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:30.874761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:30.880847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.881363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.881794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.882474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:30.882917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:30.883333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:30.914237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-24300089-96f0-4cbc-9119-c9fc7ee307a5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Aug 23 22:43:30.914699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 744/1471] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:31.101913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:31.104050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:31.110091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.110577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.111018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.111719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.114521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.114966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.152519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c9cff0ba-4122-4c77-b8ea-a3796da56212 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054507 Aug 23 22:43:31.153141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 728/1472] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:31.413184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:31.413765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:31.420219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.420769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.421269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.422008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.425240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.425928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.568786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:31.578344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:31.580205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:31.582272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c65b1a9d-b595-456e-baf2-81fcc354ddff tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.174249 Aug 23 22:43:31.582841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 745/1473] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:31 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:31.772994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:31.773516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:31.779876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.780356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.780784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.781636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.782094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.782512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.875426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lazy-loading 'services' on Instance uuid ff6f94ec-9724-4f7a-82e3-68d1713bb26c {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:43:31.927055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:31.929333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:31.935514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.935998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.942789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.942789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:31.942789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:31.942789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:31.974324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a929abee-8e76-4616-b352-8590d6bccea0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049211 Aug 23 22:43:31.974324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 746/1474] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:32.109987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dad7dd1b-aa22-469a-aa8b-f41fca8f9135 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c/os-volume_attachments/84723997-8b65-451e-90dc-01d11c5d3a44" status: 202 len: 0 microversion: 2.1 time: 0.341213 Aug 23 22:43:32.110570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 729/1475] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:43:31 2022] DELETE /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c/os-volume_attachments/84723997-8b65-451e-90dc-01d11c5d3a44 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:43:32.166187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:32.168415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:32.174758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.176472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.176472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:32.176765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.177057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.177548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:32.209342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b082bae7-7701-494e-83ee-bb15fa249fef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Aug 23 22:43:32.209914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 747/1476] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:32.606439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:32.607127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:32.614200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.614681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.615110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:32.615800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.616240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.616656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:32.751197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:32.761713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:32.763225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:32.764525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0fe9ea3d-b01e-48eb-bfe1-a0c093dddd4a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162459 Aug 23 22:43:32.765102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 730/1477] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:32.988272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:32.990479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:32.997127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.997620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.998050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:32.998737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:32.999187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:32.999608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:33.032014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c1a121d7-b0e9-45b7-9156-b8fd7314699d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048180 Aug 23 22:43:33.032896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 748/1478] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:33.224392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:33.227241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:33.233871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:33.234355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:33.234783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:33.235479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:33.235953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:33.236376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:33.269906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-de742d51-3e63-4e91-a96b-3c09aa1c2a85 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051886 Aug 23 22:43:33.270469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 731/1479] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:33.787601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:33.788206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:33.794251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:33.794733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:33.795168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:33.795859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:33.796313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:33.796734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:33.941244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:33.950449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:33.952006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:33.953160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f66cdb31-4216-408a-af73-f68f587b65d9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169692 Aug 23 22:43:33.953714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 749/1480] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:34.045431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:34.047615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:34.054432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.054914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.055407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:34.056057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.056495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.056913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:34.088697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d91751da-30c5-4e09-a093-cbe7d87437f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Aug 23 22:43:34.089210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 732/1481] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:34.282860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:34.286108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:34.292213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.292692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.293161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:34.293852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.294296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.294717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:34.325958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ade2617b-7b5f-4d97-8668-49bd6bebd813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047376 Aug 23 22:43:34.326524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 750/1482] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:34.977200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:34.977809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:34.984558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.985070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.985514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:34.986259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:34.987322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:34.987823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:35.056197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:43:35.056545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:43:35.102864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:35.107045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:35.113028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:35.113721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:35.114294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:35.115080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:35.115773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:35.116470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:35.153055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:35.153277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-29ec8a9a-fb16-4a19-905b-39c3ca1e9c3c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050274 Aug 23 22:43:35.153277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 751/1483] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:35.154898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:35.156431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:35.157699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c828af6c-8aea-43ee-972d-95a6f43824f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.184390 Aug 23 22:43:35.158265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 733/1484] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:35.339389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:35.342069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:35.348824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:35.349413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:35.349848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:35.350575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:35.351030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:35.351446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:35.382590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3d6f0b8-e8e0-4d9f-8dfc-fd4fb7c3a41e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047561 Aug 23 22:43:35.383151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 752/1485] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:36.163381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:36.165523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:36.172268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.172733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.173211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.173934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.175041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.175782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.182457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:36.183271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:36.190581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.191210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.191827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.192600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.193166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.193711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.209852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-301cf8ff-5381-4727-9b3b-c5cd18d49a98 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050994 Aug 23 22:43:36.210776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 734/1486] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:36.333433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:36.342132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:36.343668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:36.344832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-22999a8c-a45a-43a8-82bd-6f1757c83591 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166494 Aug 23 22:43:36.345567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 753/1487] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:43:36.397507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:36.400900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:36.410791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.417341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.417341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.417341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:36.417341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:36.417822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:36.447817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d96586fa-35eb-43be-aea6-36799b0d75e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056889 Aug 23 22:43:36.448392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 735/1488] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:37.223141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:37.225349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:37.232113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.232595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.233052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.233761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.234201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.234622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.266875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-50a22a64-2a48-4dc6-a82d-46de6782274d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048284 Aug 23 22:43:37.267352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 754/1489] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:37.368023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:37.368645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:37.375095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.375580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.376012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.376701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.377187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.378125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.462173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:37.465122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:37.472148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.472716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.473038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.473993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:37.474442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:37.474870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:37.497201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:37.515768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bc197e0e-7aae-42e5-9153-1b36a9433e9f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057947 Aug 23 22:43:37.516665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 755/1490] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:37.528263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:37.537771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:37.539258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:37.540419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-740abda0-4230-4743-b898-9a99cadcb21c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.176383 Aug 23 22:43:37.541103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 736/1491] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:38.279950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:38.282257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:38.290080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.290561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.290994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.291690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.292134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.292552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.326334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6e151647-c056-444e-9c1c-7b2c5b70d287 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050046 Aug 23 22:43:38.326669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 756/1492] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:38.530130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:38.532366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:38.540522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.541025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.541487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.542197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.542639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.543067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.588542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-adba8016-3f76-4368-81d4-765d69e331f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062286 Aug 23 22:43:38.589553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 737/1493] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:38.645409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:38.646252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:38.654512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.655287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.655931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.660660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:38.660660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:38.660660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:38.802563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:38.811741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:38.813294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:38.815414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11373d84-ce7d-4e9e-a1e1-ea774c7150f5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.252869 Aug 23 22:43:38.815780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 757/1494] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:38 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:39.338877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:39.341134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:39.348429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.349278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.349719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.350454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.350890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.351367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.354087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:39.386694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8def6f1-fc26-44ca-8492-d2f3d6682246 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051699 Aug 23 22:43:39.387273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 738/1495] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:39.602547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:39.604878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:39.611409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.612524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.613069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.613932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.614407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.614825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.646271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-295ede74-9f98-4d88-a44f-adf600ddabf9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047877 Aug 23 22:43:39.647212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 758/1496] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:39.840195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:39.840801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:39.848574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.849084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.849565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.850259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:39.850712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:39.851136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:39.990456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:39.999314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:40.000805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:40.002019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-990ddd9e-b680-4d5f-b6f4-e98ceff7f718 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166527 Aug 23 22:43:40.002571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 739/1497] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:40.402213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:40.404654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:40.411283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:40.411768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:40.412203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:40.412902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:40.413386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:40.413811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:40.445554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-373dc46d-c89f-4625-a1cd-4339d39d739a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Aug 23 22:43:40.446131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 759/1498] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:40.659751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:40.662249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:40.669841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:40.670448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:40.670920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:40.671737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:40.672286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:40.672742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:40.707907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7a669ec-709a-41de-8e5d-fdd30a1765e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052775 Aug 23 22:43:40.708388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 740/1499] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:41.026693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:41.027223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:41.035153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.035635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.036068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.036761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.037285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.037734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.175334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:41.184301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:41.185890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:41.187050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4780c4a4-41e9-406c-8cf5-73b9ed434006 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164459 Aug 23 22:43:41.187607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 760/1500] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:41.458225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:41.460424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:41.466913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.467395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.467832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.468524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.468974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.469422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.500828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-143893e3-26c6-4ac6-8816-9358aca4a2a9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Aug 23 22:43:41.501542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 741/1501] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:41.720503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:41.723485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:41.729613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.730237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.730532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.731216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:41.731662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:41.732075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:41.768574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5c0cd0cd-472a-4ff7-a5ed-4dcb7e0756ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050981 Aug 23 22:43:41.768574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 761/1502] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:42.210292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:42.210938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:42.217002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.217522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.217949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.218627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.219073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.219488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.354071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:42.363431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:42.364921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:42.366098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-daa38d11-c234-4185-9ac0-a207d07b1dde tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159882 Aug 23 22:43:42.366704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 742/1503] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:42.514383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:42.516637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:42.523692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.524200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.524648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.525345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.525792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.526232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.555420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-820f996c-a40c-495c-a882-ab3181695ebc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 23 22:43:42.555987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 762/1504] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:42.780128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:42.783944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:42.790415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.790899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.791333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.792035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:42.792482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:42.792906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:42.823443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7e9f1206-77fa-4f16-993d-260bd93c83bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 Aug 23 22:43:42.823987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 743/1505] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:43.390538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:43.391178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:43.397265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.397748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.398190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.398875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.399329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.399750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.531105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:43.541102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:43.542631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:43.543804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a6483c9-5a6e-4116-9eab-eb34f24fb878 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157246 Aug 23 22:43:43.544366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 763/1506] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:43.568189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:43.570661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:43.576963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.577510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.577948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.578660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.579117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.579594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.611150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e892632-ceaf-4072-a687-820d754ffc9d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Aug 23 22:43:43.612336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 744/1507] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:43.836656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:43.838775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:43.844810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.845341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.846712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.847430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:43.847887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:43.848312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:43.880836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5e27d8cf-15ef-4bba-ab21-296517f8b6b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Aug 23 22:43:43.881614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 764/1508] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:44.568457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:44.569147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:44.576509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.577035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.577498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.578215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.578663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.579113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.624477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:44.626729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:44.633756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.634464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.634839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.636077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.636529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.636953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.673501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0c155a70-1d07-4b78-a4f0-44e9ef61597b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053011 Aug 23 22:43:44.674128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 765/1509] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:44.726550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:44.736341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:44.737929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:44.739300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e38390cb-7fee-4e3c-aa81-6d16506c4dd1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.175412 Aug 23 22:43:44.740138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 745/1510] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:44 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:44.894426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:44.896498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:44.902508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.902988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.903424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.904145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:44.904592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:44.905021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:44.938116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42e8cf2a-d9a0-48a1-baae-d8314fd13c4a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048357 Aug 23 22:43:44.938694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 766/1511] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:45.687777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:45.690726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:45.697617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.698111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.698550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.699256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.699709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.700136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.731255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5d6cacd5-d616-4270-92ee-a93620f343e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Aug 23 22:43:45.731824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 746/1512] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:45.770093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:45.770783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:45.777979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.778471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.778907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.779598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.780042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.780463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.920389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:45.929246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:45.930730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:45.932388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0fc84136-a585-4fa0-b3e6-b07a15956186 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168702 Aug 23 22:43:45.932593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 767/1513] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:45.953137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:45.955968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:45.962027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.962509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.962936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.963628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:45.964079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:45.964495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:45.998936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0af6335-6dad-4e49-a420-f4ac5017b9da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049557 Aug 23 22:43:46.004106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 747/1514] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:46.743661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:46.745863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:46.752701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:46.753161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:46.753606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:46.754303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:46.754758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:46.755188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:46.787558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1789a5f4-16e6-4419-afe7-0caf0d685f50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Aug 23 22:43:46.788227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 768/1515] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:46.954375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:46.955495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:46.961954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:46.962435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:46.962865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:46.963552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:46.963996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:46.964413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:47.013687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:47.016174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:47.023664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:47.024334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:47.024896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:47.025836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:47.026401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:47.026934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:47.061350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-56e1e830-55ef-4778-baa2-a1b493ae7321 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052860 Aug 23 22:43:47.062377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 769/1516] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:47.124740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:47.134795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:47.136378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:47.137634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-99b21767-db7b-43ba-b1bf-d4d28bffb667 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.187172 Aug 23 22:43:47.138196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 748/1517] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:47.800579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:47.802794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:47.809260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:47.809746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:47.810171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:47.810859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:47.811334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:47.811752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:47.840882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a94bfa3-b812-4a5f-baf5-e3e12a4629df tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Aug 23 22:43:47.841463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 770/1518] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:48.074615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:48.076696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:48.084129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.084620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.085091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.085798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.086254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.086683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.118042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-67c1b642-5a5f-4936-b7bf-688415dc7539 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Aug 23 22:43:48.118706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 749/1519] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:48.161861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:48.162547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:48.168592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.169292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.169906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.170592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.171034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.171446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.302332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:48.311272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:48.312777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:48.313978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-16e96cb7-a941-4fa7-b5a7-5fbe84e99fee tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156098 Aug 23 22:43:48.314837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 771/1520] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:48.854365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:48.856440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:48.858353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:48.863745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.864221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.864654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.865378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:48.865826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:48.872706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:48.896598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fdd56411-107f-4e2c-bea7-fadd456d019f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Aug 23 22:43:48.897190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 750/1521] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:49.130242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:49.132316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:49.134766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=92 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:49.139860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.140341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.140771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.141499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.141946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.149397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.149397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:49.175713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ced1e85c-281d-4edd-8630-daee013b725e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049432 Aug 23 22:43:49.176287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 772/1522] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:49.338560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:49.339174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:49.345690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.346178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.346618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.347328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.347781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.348206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.491190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:49.499980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:49.501499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:49.503277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb5818b9-f393-4965-b100-ce870d8a43b5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168892 Aug 23 22:43:49.503841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 751/1523] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:49.909534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:49.911840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:49.918519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.919004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.919445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.920142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:49.920600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:49.921051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:49.952320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0906144e-3029-499e-813f-067519501855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 23 22:43:49.952895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 773/1524] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:50.192745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:50.195236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:50.202398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.202800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.203240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:50.203986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.204536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.205605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:50.237579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-062ff7f1-07fa-4a69-b820-5a95e70fa436 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049774 Aug 23 22:43:50.238333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 752/1525] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:50.526964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:50.527560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:50.534025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.534511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.543461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:50.543461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.543461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.543461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:50.672026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:50.681986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:50.683476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:50.684636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-510af79d-7587-4e4e-ae2f-5d7e80151901 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161771 Aug 23 22:43:50.685563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 774/1526] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:50.964951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:50.967146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:50.974550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.975041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.975479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:50.976187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:50.976650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:50.977115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:51.007817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e37932ea-d2dd-46b9-974d-552d1123e3e3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Aug 23 22:43:51.008394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 753/1527] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:51.251099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:51.253305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:51.260126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:51.260126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:51.260411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:51.261188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:51.261777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:51.262245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:51.293220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9d045db1-49dd-450f-8d42-3137dda292b0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Aug 23 22:43:51.293796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 775/1528] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:51.708757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:51.709398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:51.715397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:51.715884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:51.716324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:51.717031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:51.717491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:51.717909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:51.869476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:51.871686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:51.879121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:51.880633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:51.881842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a6149412-fd63-4695-ab46-dede8dc04d9f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.177202 Aug 23 22:43:51.882411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 754/1529] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:51 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:52.020805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:52.022967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:52.029370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.029849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.030280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:52.030960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.031402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.031819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:52.062172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-156d688c-b5c7-48c1-aa65-81585ef803b6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045663 Aug 23 22:43:52.062630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 776/1530] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:52.306241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:52.308393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:52.315964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.316394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.316831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:52.317560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.318014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.318473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:52.362097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-786dc3dd-90b3-4f62-9b6c-ade1165d7c6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060167 Aug 23 22:43:52.362715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 755/1531] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:52.913495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:52.914101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:52.920380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.920887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.921386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:52.922140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:52.922581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:52.923029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:53.070583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:53.080179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:53.080793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:53.082210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:53.084005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1542d77f-d1ef-425f-8438-085671796e45 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.174300 Aug 23 22:43:53.084294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:53.084635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 777/1532] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:53.093809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:53.094228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:53.094670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:53.095874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:53.096343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:53.096784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:53.140940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8b1e7deb-669e-4ee2-bb8e-52d2d7ad934f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067328 Aug 23 22:43:53.142029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 756/1533] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:53.374712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:53.377045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:53.384373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:53.384884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:53.385352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:53.386055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:53.386509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:53.386934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:53.418928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-39b26ec0-1a21-4098-9db7-b601b247779c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048183 Aug 23 22:43:53.419507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 778/1534] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:54.109485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:54.110228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:54.117881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.118418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.118863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.119571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.120023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.120446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.154382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:54.156561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:54.164385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.165545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.166001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.166750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.167213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.167712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.216693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-46aa212c-e298-4d91-8837-a988cc06b291 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066139 Aug 23 22:43:54.217578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 779/1535] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:54.265633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:54.275201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:54.276753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:54.277948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-37c385c8-3c1c-4ff0-b02b-1b37e6f277e8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.172909 Aug 23 22:43:54.278508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 757/1536] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:54.431600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:54.433754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:54.440690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.441215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.441645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.442342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:54.442794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:54.443211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:54.475568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ba51736d-0861-4859-8cf1-6ace258eb2df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047988 Aug 23 22:43:54.476177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 780/1537] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:55.231649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:55.233946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:55.241785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.242502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.243021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.243765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.244226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.244648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.276470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cadec418-e736-4505-8944-00350fd32f8c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049016 Aug 23 22:43:55.277078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 758/1538] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:55.301898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:55.302504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:55.309072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.309563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.310000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.310701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.311167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.311582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.448403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:55.458119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:55.459630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:55.460811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4855e214-047a-4dbe-a228-9268401ab310 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163543 Aug 23 22:43:55.461395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 781/1539] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:55.488212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:55.490438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:55.496478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.496973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.497447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.498152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:55.498605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:55.499032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:55.529881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4df8be1f-3239-4e64-8610-0417e5def8b9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Aug 23 22:43:55.530452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 759/1540] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:56.290210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:56.292264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:56.299257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.299768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.300206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.300936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.301415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.301839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.332812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6d00beec-c0f7-4965-a38b-9153090d335f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046855 Aug 23 22:43:56.333539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 782/1541] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:56.484552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:56.485227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:56.492621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.493245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.493723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.494509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.495041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.495508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.543213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:56.545383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:56.551893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.552403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.552845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.553589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:56.554041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:56.554468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:56.587474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-367ede1c-9dd8-4c98-962a-e5b505ba7e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Aug 23 22:43:56.588613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 783/1542] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:43:56.649406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:56.658509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:56.660145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:56.661727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d3a4d05d-7edf-4e27-a661-b56e9e5e52fb tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.181298 Aug 23 22:43:56.662365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 760/1543] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:57.347946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:57.350074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:57.356565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.357098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.357540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.358241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.358695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.359117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.389316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34c0c054-fbb8-428e-aabc-7933ebfe744c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Aug 23 22:43:57.389888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 784/1544] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:57.601303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:57.603379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:57.609377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.609859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.610292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.611742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.612196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.612617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.642851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6f063dc1-bffe-4566-b3e2-fa6df76af444 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Aug 23 22:43:57.643440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 761/1545] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:57.686581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:57.687199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:57.693819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.694711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.695155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.695858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:57.696321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:57.696746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:57.840656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:57.849709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:57.851258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:57.852481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0e49fac8-7bc1-463e-9e0d-cee581500799 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170428 Aug 23 22:43:57.852988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 785/1546] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:58.401748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:58.403807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:58.409943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.410434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.410873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:58.411593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.412042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.412466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:58.441733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-78304f85-aa7e-4ab8-8ddc-c70465e60574 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Aug 23 22:43:58.442301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 762/1547] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:58.660610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:58.663574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:58.677347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.678257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.678975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:58.680280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.680743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.681256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:58.730969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7fa47799-3a5d-4f00-a670-7d8539d06477 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078252 Aug 23 22:43:58.731706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 786/1548] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:58.876011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:58.876732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:58.883155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.883642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.884075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:58.884773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:58.885253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:58.885678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:59.024155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:59.033325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:59.034957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:43:59.036122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d73c28ba-0ea2-4b45-a8f7-0350ee2caddf tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164178 Aug 23 22:43:59.036767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 763/1549] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:43:58 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:43:59.455086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:59.457520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:59.463639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:59.464119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:59.464555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:59.465273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:59.465722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:59.466140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:59.498139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85f3b37d-6797-47ec-9af1-4d106aaa11c7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047628 Aug 23 22:43:59.498713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 787/1550] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:43:59.746050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:43:59.748113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:43:59.754830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:59.755415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:59.755739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:59.756427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:43:59.756882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:43:59.757322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:43:59.788604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-93461a1f-1835-47ca-91f3-1d190c484813 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Aug 23 22:43:59.789186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 764/1551] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:43:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:00.062911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:00.063488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:00.070793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.071282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.071756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.072434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.072888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.073350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.225420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:00.228682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:00.241217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:00.253264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:00.253264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-81295e88-d84a-404f-aa05-24d3f4ed03c5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.186963 Aug 23 22:44:00.253264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 788/1552] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:00 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:00.511365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:00.513931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:00.521212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.521873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.522320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.523026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.523481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.523910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.566853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ac4a861d-ae82-484d-bb1e-fd2ab52352f5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059632 Aug 23 22:44:00.567574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 765/1553] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:00.801438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:00.803535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:00.810100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.810586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.811057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.811752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:00.812206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:00.812630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:00.842734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-721ba216-eaa0-46dd-a069-dfaa00cbf823 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Aug 23 22:44:00.843314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 789/1554] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:01.271956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:01.272564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:01.278620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.279104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.279536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.280234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.280680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.281136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.426126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:01.435085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:01.436583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:01.437762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b94f04a3-f716-4134-a0e0-1297f338f151 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169864 Aug 23 22:44:01.438312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 766/1555] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:01.579454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:01.581786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:01.588225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.588700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.589233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.589925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.590369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.590787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.621921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b2ce7a01-1ff8-4ad4-a5c5-0fdc29197e9a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Aug 23 22:44:01.622492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 790/1556] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:01.856057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:01.858155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:01.865570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.866126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.866601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.867335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:01.867827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:01.868286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:01.899697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-21f5ec8a-3702-4096-8d68-a58e2594d142 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 Aug 23 22:44:01.900252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 767/1557] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:02.459640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:02.460248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:02.466232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.466776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.467148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.467832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.468286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.468703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.610197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:02.620475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:02.622000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:02.623553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-979b7f76-d965-427c-9b77-ab23b4632f12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167756 Aug 23 22:44:02.624150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 791/1558] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:02 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:02.634782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:02.637044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:02.643307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.643800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.644243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.644949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.645448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.645875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.677400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce300818-1aae-4b35-9fe0-5f2b66c4d640 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 23 22:44:02.677967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 768/1559] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:02.913582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:02.915662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:02.922352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.923557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.924049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.924801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:02.925341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:02.925829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:02.956287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-77a34a33-9bf8-42b8-b10c-991d70313134 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Aug 23 22:44:02.956856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 792/1560] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:03.647671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:03.648531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:03.655430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.655910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.656342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:03.657067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.659414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.659848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:03.690829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:03.692887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:03.702286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.702772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.703212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:03.703922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.706081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.706563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:03.742565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3a2c112-b318-4e26-9876-3d386121f4de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056321 Aug 23 22:44:03.751790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 793/1561] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:03.804280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:03.813112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:03.814639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:03.815912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5123c1f6-11a1-440b-b397-07a1ba91f483 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.172309 Aug 23 22:44:03.816355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 769/1562] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:03 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:03.968994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:03.971996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:03.978219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.978838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.979378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:03.980209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:03.980775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:03.981334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:04.012773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a7d3f9b7-df67-414d-baf2-cea74cf48d4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Aug 23 22:44:04.013376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 794/1563] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:04.761666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:04.763741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:04.770521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:04.771014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:04.771451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:04.772159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:04.772612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:04.773065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:04.803093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f5e7606a-f4df-4bfe-963e-bf334158f95a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Aug 23 22:44:04.803652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 770/1564] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:04.839075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:04.839802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:04.846622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:04.847112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:04.847555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:04.848260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:04.848708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:04.849158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:04.981103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:04.991048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:04.992553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:04.993746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f77f53e-6bb8-42d8-8862-3ecc2aea1b97 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158832 Aug 23 22:44:04.994304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 795/1565] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:04 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:05.025694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:05.027745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:05.034735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:05.035228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:05.035666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:05.036363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:05.036824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:05.037270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:05.052644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:05.068468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-42d84ea8-7d70-49c3-a770-1b82b92fe6a2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Aug 23 22:44:05.069333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 771/1566] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:05.816077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:05.818286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:05.824446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:05.824920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:05.826165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:05.826165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:05.826485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:05.826898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:05.857261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85e0908e-af69-445d-b456-37fe843f9cc7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045574 Aug 23 22:44:05.857878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 796/1567] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:06.018581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:06.019178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:06.026291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.026770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.027212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.028007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.028373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.028796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.082533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:06.084651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:06.091153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.091790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.092250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.092992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.093478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.093949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.127010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-86d3adf9-92b4-4730-bcd4-68a4e0d3ca84 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048747 Aug 23 22:44:06.127603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 797/1568] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:06.168795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:06.178255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:06.179799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:06.180968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5bb36075-cb81-4119-aa25-e4900cf641f6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.167113 Aug 23 22:44:06.181692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 772/1569] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:06 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:06.869882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:06.871932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:06.878657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.879135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.879636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.880279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:06.880756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:06.881203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:06.912697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4b5b13da-d7dc-46c6-823e-9b5a8f988982 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Aug 23 22:44:06.913310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 798/1570] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:07.138903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:07.140981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:07.148430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.148913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.149385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.150122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.150582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.151013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.184684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3afadc9e-4fae-4da8-80df-1e39005fd2f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Aug 23 22:44:07.185314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 773/1571] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:07.206085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:07.206691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:07.212699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.213215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.213650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.214335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.214777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.215191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.351887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:07.360917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:07.362432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:07.363594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-348a998e-40dd-4983-845c-ff381e2ab58a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162565 Aug 23 22:44:07.364145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 799/1572] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:07 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:07.925967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:07.928078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:07.934249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.934739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.935177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.935892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:07.936343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:07.936767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:07.967563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f1daff61-9d42-46ca-97ec-e98f20a8b33f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Aug 23 22:44:07.968135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 774/1573] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:08.197735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:08.200046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:08.206644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.207115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.207539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:08.208226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.208703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.209146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:08.239332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e70d5bfb-4239-4187-b5b1-6076fca91bfe tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Aug 23 22:44:08.239911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 800/1574] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:08.386510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:08.387113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:08.394486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.394969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.395399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:08.396094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.396543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.396963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:08.529348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:08.538602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:08.540124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:08.541307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-27ada032-2d3b-4fff-9b5a-c9b4b1d81884 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158713 Aug 23 22:44:08.541869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 775/1575] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:08 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:08.980308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:08.982517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:08.988693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.989217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.989673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:08.990346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:08.990801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:08.991228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:09.021650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-023ffbe2-72e7-47a6-9a1e-78ba2bdd85b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045362 Aug 23 22:44:09.022268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 801/1576] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:09.252010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:09.254082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:09.259942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:09.260419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:09.260847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:09.261556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:09.261999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:09.262413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:09.290191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1a1da258-4e68-47ff-b3e5-f61b01ff1379 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Aug 23 22:44:09.290736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 776/1577] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:09.564783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:09.565420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:09.571796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:09.572276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:09.572710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:09.573429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:09.573883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:09.574303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:09.712303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:09.721917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:09.723823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:09.724981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a1d3468c-27c3-4f6d-a2f0-c331ab294f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164157 Aug 23 22:44:09.725559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 802/1578] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:09 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:10.034948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:10.037183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:10.043857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.044349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.044806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.045541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.046000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.046426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.076342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-da3bc48e-e43a-45bc-9286-026ca113065b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Aug 23 22:44:10.076914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 777/1579] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:10.302914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:10.305150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:10.311171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.311661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.312092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.312784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.313785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.314460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.345278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ea59b84f-8974-4b89-8d39-ecec51bc50ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 23 22:44:10.345841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 803/1580] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:10.748028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:10.748644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:10.756002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.756488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.756926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.757645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:10.758102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:10.758642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:10.892168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:10.900688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:10.902216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:10.903364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-719d8fe3-638e-4a99-b009-668064d386d5 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159423 Aug 23 22:44:10.903937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 778/1581] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:10 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:11.089271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:11.091346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:11.098348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.098821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.099245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.099922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.100408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.100835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.130767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-28d02113-747d-4582-9dfe-8aae3830f0c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Aug 23 22:44:11.131336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 804/1582] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:11.357698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:11.359799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:11.366841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.367317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.367743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.368418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.368861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.369308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.399634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-36ab9cbe-7764-4455-9040-241a63b7a3de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 23 22:44:11.400264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 779/1583] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:11.926155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:11.926851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:11.932629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.933153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.933593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.934301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:11.934750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:11.935170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:11.950987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:12.066028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:12.074922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:12.076422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:12.077615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-908012e4-05d9-4c98-b9c4-726e8e1e359d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.155717 Aug 23 22:44:12.078175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 805/1584] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:11 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:12.143153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:12.145505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:12.151503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:12.151988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:12.152429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:12.153431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:12.153890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:12.154319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:12.184065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-27783be5-ce81-48f2-9b05-121698e3d3e0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Aug 23 22:44:12.184618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 780/1585] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:12.412102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:12.414211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:12.420593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:12.421089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:12.421525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:12.422198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:12.423277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:12.423697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:12.452343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2179c6f8-b7b4-407b-bd26-bf8dc65d58c0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 23 22:44:12.452885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 806/1586] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:13.102215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:13.102819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:13.109192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.109671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.110685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.111448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.111894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.114255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.196683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:13.199120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:13.205847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.207706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.207706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.208033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.208253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.208666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.242305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8ed90182-f2d9-495c-8416-1e97e5f4a2b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049761 Aug 23 22:44:13.242889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 807/1587] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:13.256362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:13.265193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:13.266853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:13.268016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a96b6526-c658-4162-9680-3e2de0ac3ca6 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.169848 Aug 23 22:44:13.268567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 781/1588] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:13 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:13.464563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:13.466942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:13.474225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.474708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.475141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.475828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:13.476272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:13.476692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:13.506409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-12fa9327-c6f6-452c-b2ee-1a046136f308 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Aug 23 22:44:13.506966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 808/1589] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:14.256265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:14.258475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:14.264688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.265212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.265653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.267153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.267611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.268038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.291472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:14.292177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:14.298918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.299397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.300056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.300180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c8b59a28-956a-4cdf-98e0-961c8f32c2e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Aug 23 22:44:14.300646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 782/1590] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:14.301208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.301671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.302105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.451823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:14.461882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:14.463390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:14.464553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-636c20fa-22b2-4031-bb99-32677390487e tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.177228 Aug 23 22:44:14.465134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 809/1591] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:14 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:14.519351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:14.521733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:14.528171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.528662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.529129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.529834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:14.530287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:14.530718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:14.563642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-50cc1634-92fe-4b85-8484-0401ff5ee662 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049105 Aug 23 22:44:14.564219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 783/1592] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:15.312077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:15.314172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:15.320837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.321366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.321798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.322481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.322924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.323338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.355020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-589e1912-1e2f-43e2-a4a3-66c667f9aca1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 23 22:44:15.355572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 810/1593] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:15.489561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:15.490167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:15.496905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.497420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.497855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.498589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.499032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.499448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.576808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:15.580204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:15.587093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.587713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.588501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.589785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:15.589918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:15.590314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:15.622599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eafc0afa-c9d3-46d2-aa19-9bc73765c4bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050409 Aug 23 22:44:15.623440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 811/1594] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:15.645129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:15.654167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:15.655814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:15.657023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8362c32-8f84-4bda-8bb1-a971197141cd tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.171354 Aug 23 22:44:15.657578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 784/1595] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:15 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:16.367445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:16.369576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:16.375970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.376453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.376895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.377613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.378069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.378491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.407853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-466aec93-babf-4900-a8c3-ad4523298cd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Aug 23 22:44:16.408413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 812/1596] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:16.635933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:16.638414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:16.646108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.646645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.647123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.648015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.648528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.649025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.679816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:16.680556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:16.682698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-119fbb03-14b3-4ee9-8d99-cbebdc5299cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051432 Aug 23 22:44:16.683605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 785/1597] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:16.686936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.687444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.688455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.689195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:16.689653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:16.691520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:16.827768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:16.837644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:16.839162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:16.840380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-464c66d5-7d02-41a8-9a7a-44e4a3c2cc88 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164534 Aug 23 22:44:16.840940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 813/1598] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:16 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:17.420470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:17.422643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:17.428650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.429273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.429720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:17.430414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.430871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.431299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:17.460978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be2494e4-1054-4e9f-a95b-6012af34acd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 23 22:44:17.461554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 786/1599] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:17.695423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:17.697612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:17.704376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.704875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.705347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:17.706032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.706476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.706892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:17.735377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-137fea35-2ad0-4855-bbd3-67f1f9ca1eff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 23 22:44:17.735960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 814/1600] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:17.864262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:17.864872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:17.870798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.871279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.871711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:17.872397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:17.872846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:17.873291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:18.006525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:18.015153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:18.016670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:18.017885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ff896028-b2ef-472c-aecf-b2c0595964f2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158154 Aug 23 22:44:18.018428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 787/1601] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:17 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:18.473630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:18.475737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:18.481716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:18.482199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:18.482638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:18.483332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:18.483786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:18.484209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:18.515301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-deec7e02-b7ea-4f6b-91a8-03c4d3329006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046628 Aug 23 22:44:18.516487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 815/1602] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:18.747973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:18.751073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:18.759181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:18.759669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:18.760118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:18.760808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:18.761286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:18.761712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:18.764175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:18.793967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c7e6280e-51ec-41a0-9951-6fba83d11ec3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050138 Aug 23 22:44:18.794534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 788/1603] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:19.041270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:19.041877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:19.048306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.048793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.049257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.049952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.050403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.050827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.179175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:19.187836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:19.189373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:19.190546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8e6d076b-506e-4b86-8dcf-240496a6e9da tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.153154 Aug 23 22:44:19.191106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 816/1604] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:19 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:19.529491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:19.532134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:19.534016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:19.539141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.539670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.540148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.540848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.541334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.546447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.573385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4ceca3b5-b9ff-4435-b21e-916eda07a30b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 Aug 23 22:44:19.573953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 789/1605] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:19.808024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:19.810223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:19.816431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.816988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.817391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.818343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:19.818794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:19.819218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:19.849608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9538af53-b215-4795-8e5d-9ca6e207bd7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Aug 23 22:44:19.850271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 817/1606] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:20.214170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:20.214781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:20.221497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.221977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.222471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.223164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.223612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.224030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.354408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:20.364595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:20.366517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:20.367743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-74512926-e8c0-47bf-bc47-c4d5bdcd5052 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157498 Aug 23 22:44:20.368323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 790/1607] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:20 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:20.585709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:20.587872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:20.590193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=92 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:20.595634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.596108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.596536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.597307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.597754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.598169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.628063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4d3efc9-5f1c-4dad-b98b-99de7e29ef20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Aug 23 22:44:20.628600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 818/1608] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:20.862661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:20.864823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:20.870839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.871319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.871754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.872447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:20.872898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:20.873345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:20.902932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b1116dac-cc93-4cdb-b775-840d0e33b36e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Aug 23 22:44:20.903490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 791/1609] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:21.392582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:21.393146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:21.399718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.400202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.400638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.401377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.401823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.402249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.540015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:21.549191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:21.550701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:21.551864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-56d64879-17bf-4a24-be03-df3fa150bd37 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163986 Aug 23 22:44:21.552424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 819/1610] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:21 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:21.650712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:21.650939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:21.656796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.657335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.657775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.658471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.658920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.659342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.689454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fac3e169-ba8f-4ffb-86ba-9443ceb3fab6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 23 22:44:21.690253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 792/1611] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:21.916666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:21.918819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:21.926022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.926509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.926946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.927647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:21.928100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:21.928519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:21.958923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4caa21b9-741b-488e-9a3b-c04edd7a2a80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Aug 23 22:44:21.959489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 820/1612] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:22.575730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:22.576336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:22.582254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.582729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.583162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:22.583839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.584284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.584701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:22.703699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:22.706471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:22.713057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.713550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.714016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:22.714711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.715155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.715574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:22.718440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:22.728039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:22.729589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:22.730772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c8c86295-80f3-45de-828c-c86f461de60d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159031 Aug 23 22:44:22.731327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 793/1613] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:22 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:22.746265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a80de85-b219-4c7d-bce3-2feb8533b1ed tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Aug 23 22:44:22.746811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 821/1614] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:22.971579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:22.973846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:22.979811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.980299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.980739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:22.981458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:22.981916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:22.982340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:23.012342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3a7d537c-6504-4c44-a402-a07da0872fe2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Aug 23 22:44:23.012953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 794/1615] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:23.754412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:23.754978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:23.759710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:23.761620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:23.761977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:23.762092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:23.762533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:23.763235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:23.763698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:23.764123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:23.768555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:23.769727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:23.770213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:23.770650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:23.771388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:23.771842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:23.772266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:23.805381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-af0f12ee-2476-4662-81a3-20b403caa73a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051022 Aug 23 22:44:23.805959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 795/1616] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:23.899617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:23.910229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:23.911751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:23.912914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe8639ae-1628-40c0-9a5b-d439072eb98c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163322 Aug 23 22:44:23.913542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 822/1617] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:23 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:24.025650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:24.027860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:24.033964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.034455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.034882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:24.035583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.036032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.036487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:24.065579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5fdf4a56-2314-464d-9643-a934d315bb6e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Aug 23 22:44:24.066136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 796/1618] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:24.817994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:24.820081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:24.826650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.827128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.827561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:24.828247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.828790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.829247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:24.861659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-92286f09-5348-4135-9a1c-038d99d381cf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Aug 23 22:44:24.862218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 823/1619] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:24.936160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:24.936749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:24.943583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.944070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.944508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:24.945228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:24.945681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:24.946105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:25.102735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:25.102735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:25.102735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:25.102735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:25.103388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:25.103388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:25.103388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:25.103388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:25.103732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:25.103965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:25.105590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:25.106855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e7c0537-1377-4957-b2af-6a2d067c6961 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.174616 Aug 23 22:44:25.107412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 797/1620] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:24 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:25.121995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d05a6535-9fd7-431f-b0d3-9b61052f0227 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Aug 23 22:44:25.123130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 824/1621] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:25.873954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:25.876077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:25.882731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:25.883205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:25.883632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:25.884309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:25.884751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:25.885199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:25.915674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6dd144c7-bb5f-4e6f-aeac-68ae88e98629 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Aug 23 22:44:25.916251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 798/1622] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:26.133576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:26.134161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:26.134628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:26.136125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:26.140919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.141432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.142042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.142650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.143111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.143260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.143701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.143819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.144175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.144482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.144939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.145399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.176729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2f726eeb-bfd5-4926-acfe-1195c3fb6d3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Aug 23 22:44:26.177334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 799/1623] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:26.279984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:26.289531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:26.291015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:26.292152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a8047349-14bb-4f4c-be82-7997f28345fa tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162611 Aug 23 22:44:26.292707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 825/1624] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:26 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:26.928365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:26.930590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:26.936515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.936992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.937452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.938139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:26.938590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:26.939513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:26.969145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2769d9b0-c855-470f-afa1-121b6543502c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Aug 23 22:44:26.969700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 800/1625] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:27.190250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:27.192301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:27.198998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.199474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.199901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:27.200586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.201049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.201473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:27.230523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e887291-ec59-4be9-a647-bd13f5e3c550 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Aug 23 22:44:27.231072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 826/1626] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:27.316491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:27.317351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:27.323763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.324251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.324698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:27.325431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.325886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.326312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:27.463755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:27.473156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:27.474710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:27.475942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-427df7bb-5779-46b3-b16d-5d151c8d0f87 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.164079 Aug 23 22:44:27.476464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 801/1627] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:27 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:27.981570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:27.983796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:27.990446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.990933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.991364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:27.992052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:27.992494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:27.992909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:28.023464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5c6819c1-1d76-4ce7-89db-2abb0a9ecec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 23 22:44:28.024029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 827/1628] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:28.243740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:28.245689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:28.252291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:28.252771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:28.253240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:28.253940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:28.254383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:28.254799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:28.285949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9458adaa-5cea-45e2-a67b-1ca1993445ab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Aug 23 22:44:28.286520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 802/1629] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:28.499428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:28.500021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:28.506786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:28.507262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:28.507690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:28.508376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:28.508823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:28.509273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:28.640949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:28.651908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:28.653447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:28.654626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-67f7019a-3001-4d5e-becc-cfe395011e32 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159114 Aug 23 22:44:28.655176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 828/1630] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:28 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:29.036687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:29.039628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:29.049046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.049990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.050620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.051528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.052210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.052833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.090510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2cb93719-0251-4145-8eac-cbe77399b3a7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058453 Aug 23 22:44:29.091072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 803/1631] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:29.299685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:29.301901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:29.307960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.308436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.308864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.309583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.310055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.310468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.340585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cc94acfa-80aa-4f7f-bc6e-a611480015cc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Aug 23 22:44:29.341157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 829/1632] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:29.684808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:29.685443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:29.692199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.692943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.693407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.694100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:29.694549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:29.694975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:29.831513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:29.833732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:29.840687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:29.842249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:29.843448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1a5ae718-b575-4bc3-86a0-edf0f1d0bd9c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.162677 Aug 23 22:44:29.844042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 804/1633] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:29 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:30.103724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:30.105843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:30.112853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.113369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.113801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:30.114493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.114937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.115355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:30.147230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-03094aa1-46a9-4fb6-8ffb-658eae6fd2aa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Aug 23 22:44:30.147802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 830/1634] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:30.354045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:30.356191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:30.363807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.364287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.364763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:30.365518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.365973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.366396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:30.394899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7191c895-b3b6-42e9-888d-ba861267936a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Aug 23 22:44:30.395450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 805/1635] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:30.882278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:30.882812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:30.888685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.889200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.889631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:30.890307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:30.890747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:30.891191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:31.027434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:31.036751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:31.038300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:31.039472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c786d299-e543-4aa1-b802-b4c314ba37d7 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.161129 Aug 23 22:44:31.040026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 831/1636] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:30 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:31.159849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:31.161963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:31.167864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:31.168351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:31.168788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:31.169509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:31.169964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:31.170388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:31.200865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ada05a30-b871-479b-af87-263029105501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Aug 23 22:44:31.201594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 806/1637] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:31.407415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:31.409590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:31.416002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:31.416415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:31.416846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:31.417560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:31.417996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:31.418418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:31.449956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-60039711-ad40-4457-a3f9-341116747b20 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Aug 23 22:44:31.450514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 832/1638] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:32.069235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:32.069842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:32.076327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.076796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.077269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.077940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.078381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.078797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.209223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:32.215078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:32.217627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:32.218840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:32.221511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:32.222677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8cc3672d-1db2-4ad0-b982-181e1c45d8a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157610 Aug 23 22:44:32.223244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 807/1639] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:32 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:32.224618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.225135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.225579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.226304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.226762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.227190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.256958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb9645c6-3bac-48eb-8ad2-17607604e6dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Aug 23 22:44:32.257546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 833/1640] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:32.462311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:32.464458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:32.470628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.471128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.471586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.472264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:32.472715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:32.473173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:32.502703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b269cbb-767f-444f-a70c-cbb45accc461 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Aug 23 22:44:32.503259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 808/1641] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:33.245718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:33.246299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:33.253267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.253742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.254172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.254850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.255291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.255736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.269848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:33.272125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:33.278694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.279182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.279619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.280320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.280772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.281229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.311781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-552d3518-0a05-4629-9d2e-34f2f57b9b4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Aug 23 22:44:33.312251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 809/1642] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:33.385107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:33.394873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:33.396363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:33.397553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0bab9ec2-21af-4d90-b493-a771cca349e0 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.155791 Aug 23 22:44:33.398105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 834/1643] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:33 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:33.514191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:33.516327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:33.522344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.522835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.523271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.523959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:33.524406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:33.524828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:33.553078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-318100fb-a6b1-4cfd-9386-f7bc62144da1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Aug 23 22:44:33.553645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 810/1644] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:34.324851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:34.326977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:34.333822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.334302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.334727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.335405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.335846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.336258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.365847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0b34bb83-64b1-4398-b0a1-11c339f6215f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Aug 23 22:44:34.366393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 835/1645] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:34.422429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:34.423096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:34.429522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.429995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.430421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.431103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.431562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.431960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.565088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:34.572046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:34.572316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:34.573445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.573930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.574394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.575102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:34.575491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:34.575908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:34.581696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:34.583367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:34.584678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0f0624a7-5937-4e68-bec7-4341accff6a2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.166792 Aug 23 22:44:34.585317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 811/1646] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:34 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:34.606881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fba0f470-64bc-4fd9-af32-614b5155c311 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Aug 23 22:44:34.607431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 836/1647] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:35.352532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:44:35.352802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:44:35.378283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:35.380552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:35.387740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.388227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.388670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.389394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.389854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.390282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.420442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-70dc2a54-e988-48b9-add0-77f8b396c5c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Aug 23 22:44:35.420995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 812/1648] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:35.608565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:35.609167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:35.616577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.617108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.617541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.618240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.618686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.619124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.621622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:35.623829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:35.630968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.631619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.632057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.632764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:35.633251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:35.633675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:35.667380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-138e99b6-1340-4e6c-abbf-418a6a3f4900 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049700 Aug 23 22:44:35.667981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 813/1649] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:35.762346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:35.771885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:35.773421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:35.774682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2c860b83-17f4-4611-a37e-2e2bab2b50ab tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.170117 Aug 23 22:44:35.775252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 837/1650] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:35 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:36.433581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:36.435698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:36.442464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.442948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.443380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.444065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.444508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.444923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.474578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d598f32b-7b9d-4a8b-bada-e19c75bacc6d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 23 22:44:36.475132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 814/1651] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:36.680122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:36.682370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:36.692615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.692615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.692615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.692615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.693223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.693223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.716149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:36.720977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7af7ca85-8d02-442c-98b7-f92020a2bd49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Aug 23 22:44:36.721556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 838/1652] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:36.798394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:36.799143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:36.805589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.806079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.806522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.807222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:36.807672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:36.808095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:36.941766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:36.950751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:36.952363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:36.953576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45c3911f-21ee-47f6-876b-1d921b55fc56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159847 Aug 23 22:44:36.954676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 815/1653] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:36 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:37.045704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:44:37.045871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:44:37.488163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:37.490373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:37.496521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.497073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.497520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:37.498212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.498663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.499095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:37.529233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-af1bb91e-fdcc-4371-84ce-b41459acf939 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Aug 23 22:44:37.529793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 839/1654] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:37.733300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:37.736111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:37.742170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.742603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.743073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:37.743754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.744215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.744629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:37.773087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2b2b7863-706c-495a-9c12-d93446df1948 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 23 22:44:37.773642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 816/1655] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:37.977243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:37.977857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:37.984160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.984643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.985724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:37.986560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:37.987024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:37.987451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:38.119379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:38.128197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:38.129743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:38.130912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-663df70c-591d-421a-b412-d66113c97e3f tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157667 Aug 23 22:44:38.131472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 840/1656] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:37 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:38.541889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:38.543983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:38.551341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:38.551833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:38.552304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:38.553025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:38.553489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:38.553913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:38.584203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0c1b1ba9-f5fc-4617-aef8-0671355b5ba8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Aug 23 22:44:38.584767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 817/1657] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:38.786461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:38.788674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:38.797290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:38.797290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:38.797290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:38.797290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:38.797965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:38.797965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:38.830651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-50f27698-2f30-49b1-9bc9-851db8980fc5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048812 Aug 23 22:44:38.831253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 841/1658] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:39.154458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:39.155078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:39.161295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.161781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.162215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.162906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.163360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.163784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.295225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:39.304816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:39.306364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:39.307529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-54c74340-e186-4a67-9577-08ada694e6c2 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.156998 Aug 23 22:44:39.308069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 818/1659] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:39 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:39.596999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:39.599142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:39.605540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.606012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.606438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.607117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.607558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.607973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.638557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a10cb28-77ab-4dd3-a296-7a31f27b87bf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045797 Aug 23 22:44:39.639106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 842/1660] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:39.842344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:39.844957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:39.851365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.851841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.852271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.852955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:39.853427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:39.853842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:39.882727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bd162539-5e1d-407f-8b8e-4821dfd07b19 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 23 22:44:39.883273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 819/1661] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:40.331552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:40.332161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:40.338229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.338721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.339204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.339914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.340370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.340791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.473700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:40.482234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:40.484747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:40.485457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bc6430ec-6e5d-4f3e-a7cf-f8db68dc6a18 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.157755 Aug 23 22:44:40.486523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 843/1662] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:40 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:40.651236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:40.653462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:40.659993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.660481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.660939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.661809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.662266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.662726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.694959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8e41a11e-95cd-4394-a378-eee4ab08e5f4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047759 Aug 23 22:44:40.695523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 820/1663] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:40.895094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:40.897333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:40.903774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.904263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.904703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.905432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:40.905885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:40.906308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:40.934935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ea2bdf8b-5db8-4ad3-8280-a5b4c8e63d40 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Aug 23 22:44:40.935494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 844/1664] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:41.508867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:41.509464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:41.515788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.516989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.517487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.518178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.518635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.519057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.536415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:41.658692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:41.667642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:41.669175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:41.670359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d89a0aec-89d7-48f7-9aeb-ba6b31ce2490 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.165495 Aug 23 22:44:41.670920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 821/1665] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:41 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:41.708097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:41.710289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:41.716272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.716682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.717140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.717819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.718259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.718675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.747899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-30875bf7-6fbf-4924-853d-6d3aabfda568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Aug 23 22:44:41.748445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 845/1666] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:41.948176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:41.950418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:41.956927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.957445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.957883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.958574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:41.959025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:41.959447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:41.987985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-53e01378-98fc-4c7c-86a5-4d71ce85c5e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Aug 23 22:44:41.988539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 822/1667] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:42.693733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:42.694350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:42.700808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:42.701330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:42.701776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:42.702464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:42.702915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:42.703347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:42.759948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:42.762133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:42.768836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:42.769407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:42.769797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:42.770499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:42.771098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:42.771517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:42.802694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-18eecbb2-bfc4-4c58-baba-9c34d1057a3b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Aug 23 22:44:42.803263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 823/1668] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:42.838271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:42.847646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:42.849176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:42.850332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-55f01987-d6cc-472b-a9d2-0ab994af63f1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.160953 Aug 23 22:44:42.850892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 846/1669] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:42 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:42.999772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:43.002072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:43.008052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.008538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.008977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:43.009697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.010158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.010586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:43.040448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-37637331-3f36-4ff5-abc7-b346e01f812e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Aug 23 22:44:43.041030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 824/1670] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:43.815296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:43.817767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:43.824154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.824642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.825111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:43.825807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.826268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.826694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:43.855604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b12885ef-e2bf-40eb-8c78-2039bd38ea6c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Aug 23 22:44:43.856162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 847/1671] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:43.873509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:43.874120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:43.881080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.881484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.881951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:43.882609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:43.883225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:43.883606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:44.022113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:44.030653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:44.032186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:44.033372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dd4e18b9-6125-4ca3-a473-750f978b33a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163811 Aug 23 22:44:44.033946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 825/1672] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:43 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:44.052804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:44.054943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:44.060799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:44.061312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:44.061745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:44.062436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:44.063712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:44.064418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:44.092949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a121ff77-9602-4579-a156-c91844536265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Aug 23 22:44:44.093528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 848/1673] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:44.868034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:44.870348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:44.876472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:44.877096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:44.877417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:44.878113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:44.878571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:44.878996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:44.909973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ffb27dd-d6fd-4502-9b5d-29773f9197d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Aug 23 22:44:44.910540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 826/1674] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:45.056862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:45.057508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:45.063899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.064390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.064832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.065566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.066139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.066566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.105003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:45.107197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:45.113689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.114635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.114635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.115355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.115807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.116238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.147837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4434fde0-db0d-453a-be6b-99bfae0d9058 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Aug 23 22:44:45.148178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 827/1675] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:45.199071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:45.208624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:45.210213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:45.211384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a4a6e93e-8a59-4eed-aa93-1b718b0471c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158830 Aug 23 22:44:45.211948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 849/1676] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:45 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:45.923068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:45.925248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:45.931698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.932187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.932628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.933365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:45.933822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:45.934248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:45.969975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d4390848-bc81-4000-a3dd-bb203cac70b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050909 Aug 23 22:44:45.970706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 828/1677] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:46.159609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:46.161728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:46.168209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.168695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.169162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:46.169853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.170305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.170721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:46.202307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e397b3c7-e83a-4f82-b7a6-b811ebf26643 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047309 Aug 23 22:44:46.202876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 850/1678] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:46.235463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:46.236082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:46.242250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.242866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.243291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:46.243991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.244529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.244964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:46.389840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:46.398983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:46.400506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:46.401687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1dec9ca-0898-4542-bc75-ed9bc8405a3d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.171711 Aug 23 22:44:46.402239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 829/1679] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:46 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:46.982469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:46.985242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:46.991203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.991744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.992128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:46.992817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:46.993311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:46.993742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:47.023105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9c40f28a-3c4c-4653-9aee-a463547b1f03 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Aug 23 22:44:47.023666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 851/1680] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:47.214767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:47.216908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:47.223206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:47.223685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:47.224119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:47.224811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:47.225295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:47.225717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:47.255404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-842880e2-f923-4a17-a21a-82d3b8db965c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 23 22:44:47.255877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 830/1681] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:47.426761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:47.427365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:47.433771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:47.434258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:47.434696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:47.435389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:47.435845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:47.436269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:47.568332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:47.576851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:47.579297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:47.580524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-095ed02e-b00a-4229-aab9-b86d17693d92 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158637 Aug 23 22:44:47.581106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 852/1682] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:47 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:48.035251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:48.037398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:48.043277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.043754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.044184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.044861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.045396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.045818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.075944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-de8ca5e8-8c2c-41bf-8bd8-5c4476de5f87 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 23 22:44:48.076416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 831/1683] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:48.267885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:48.270064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:48.276017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.276494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.276929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.277711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.278196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.278619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.307833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-85866e7e-5031-41f3-af1c-397a3da94a63 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 23 22:44:48.308384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 853/1684] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:48.603015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:48.603623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:48.610462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.610960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.611400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.612126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:48.612554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:48.613052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:48.746541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:48.755673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:48.757267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:48.758406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2637bdb0-6847-4c9c-9437-8aa4571cfafc tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159383 Aug 23 22:44:48.759315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 832/1685] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:48 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:49.089831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:49.092144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:49.099045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.099570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.100015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.100752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.101253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.101683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.131692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1a66f1ab-dec1-40e7-abba-c25e0f4f38bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046317 Aug 23 22:44:49.132246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 854/1686] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:49.320426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:49.322572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:49.328466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.328937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.329397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.330079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.330526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.330944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.359237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bb1a0f49-face-4c5a-9bf8-fa6d4495f6d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Aug 23 22:44:49.360366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 833/1687] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:49.782718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:49.783325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:49.789332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.789818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.790477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.790932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:49.791382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:49.791804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:49.807636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:49.926281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:49.934785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:49.936326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:49.937958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a37f003-1b44-4c5e-a7e5-5b3f2a0aaaea tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159719 Aug 23 22:44:49.938771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 855/1688] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:49 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:50.144489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:50.146687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:50.149059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=90 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:50.153755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.160405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.160405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:50.160405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.160405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.161057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:50.189112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-361f1c44-d813-4984-a57c-3c8300561c76 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048889 Aug 23 22:44:50.189874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 834/1689] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:50.371857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:50.374057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:50.380922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.381564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.381989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:50.382670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.383114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.383524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:50.412251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f4ecc9c8-5916-4cc4-9de8-9878fc1781bd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 23 22:44:50.412806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 856/1690] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:50.960963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:50.961602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:50.967550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.968037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.968484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:50.969631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:50.970087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:50.970543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:51.100414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:51.109349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:51.111103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:51.112276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1c42a808-05ce-49f4-a80e-849403c6b319 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.155260 Aug 23 22:44:51.112832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 835/1691] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:50 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:51.201548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:51.203769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:51.209752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:51.210231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:51.210665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:51.211375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:51.211820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:51.212240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:51.241446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ebb9407d-d452-4412-8d09-c1201a4f5094 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 23 22:44:51.241995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 857/1692] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:51.425300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:51.427370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:51.433755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:51.434240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:51.434676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:51.435366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:51.435817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:51.436241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:51.467403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4e33b4db-f01f-4e93-9d56-84d4370006f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 Aug 23 22:44:51.467962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 836/1693] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:52.135667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:52.136220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:52.138562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=80 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:52.144249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.144735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.145205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.145897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.146343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.146768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.254884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:52.257241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:52.263253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.263744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.264186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.264893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.265383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.266514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.283643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:52.292262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:52.293786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:52.294952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3a150f5-049f-464f-baae-a5352f72e6ae tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.163461 Aug 23 22:44:52.295516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 858/1694] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:52 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:52.296814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c225352e-49b6-44d3-9b25-3797a68a079c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046986 Aug 23 22:44:52.297592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 837/1695] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:52.479102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:52.481243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:52.488136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.488618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.489074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.489765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:52.490209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:52.490623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:52.520521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e9e14bb-26f7-47a3-8a3e-3ddf049f0f7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 23 22:44:52.521090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 859/1696] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:53.308947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:53.311151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:53.318474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.318752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:53.319170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.319366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:53.319493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.320074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.320531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.320958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.324714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:53.326252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.326737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.327179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.327869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.329268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.329809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.350952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9831b8d5-6753-469f-a014-9df4b2070946 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Aug 23 22:44:53.351522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 838/1697] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:53.461063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:53.469644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:53.471151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:53.472317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-51717606-d90e-4361-8a06-14ddef305df8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.158130 Aug 23 22:44:53.472882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 860/1698] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:53 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:53.532375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:53.534638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:53.541132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.541613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.542046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.542734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:53.543181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:53.543615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:53.574114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f62ec1a6-65b1-47f6-ad57-9ea9a868bf3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Aug 23 22:44:53.574596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 839/1699] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:54.363609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:54.365779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:54.372211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.372683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.373142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.373818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.374265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.374683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.404544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9fe2e220-69f1-4bdb-8cfc-6684d9e96820 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Aug 23 22:44:54.405124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 861/1700] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:54.495701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:54.496311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:54.503491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.503946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.504386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.505117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.505573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.505996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.586723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:54.589120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:54.595282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.595763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.596195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.596882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:54.597394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:54.597810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:54.628167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae4b9dce-df56-4dc9-a885-56e39c6835f2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Aug 23 22:44:54.628646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 862/1701] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:54.638570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:54.648241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:54.649796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:54.650969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1000bfe5-7ec0-46c2-8f04-c5bb48826e50 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.159175 Aug 23 22:44:54.651530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 840/1702] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:54 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:55.417797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:55.419863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:55.427112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.427592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.428030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.428721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.429213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.429638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.458711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-63c3c819-a6b2-4f2a-8deb-baa2c0b436de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Aug 23 22:44:55.459267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 863/1703] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:55.640031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:55.642743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:55.649542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.650032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.650476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.651179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.651634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.652059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.673697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:55.674225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:55.680583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.681102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.681541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.682247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:55.682701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:55.683125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:55.683335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-132d7e54-e335-4564-9586-b902fc19035b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047269 Aug 23 22:44:55.683910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 841/1704] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:55.826324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:55.835545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:55.837090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:55.838267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-67895a5e-934d-4e15-ae0e-34c9df4648f3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.168779 Aug 23 22:44:55.838825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 864/1705] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:55 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:44:56.471238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:56.473454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:56.479462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.479944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.480384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:56.481114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.481571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.481998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:56.513823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c4e9b373-7c58-48a1-a0f7-1a3e5497ab22 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Aug 23 22:44:56.514380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 842/1706] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:56.696431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:56.698615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:56.705264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.705745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.706172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:56.706857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.707300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.707714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:56.737136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c16e2498-107a-477c-a14b-03769d2b8de6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Aug 23 22:44:56.737618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 865/1707] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:56.862730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:56.863367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:56.869890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.870379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.870820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:56.871514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:56.871974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:56.872480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.000894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:57.009614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:57.011136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:44:57.012304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-02f77a9b-3d6f-4713-8c53-9ab2ef7a9d56 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 200 len: 1745 microversion: 2.20 time: 0.154173 Aug 23 22:44:57.012868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 843/1708] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:44:56 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:44:57.090133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:57.090633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:57.098355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.099137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.099853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.101108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.101852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.102560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.526559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:57.529003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:57.536139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.536702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.537244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.538037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.538555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.539070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.572670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4043c39b-5c11-4502-b106-827ff11e222d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050216 Aug 23 22:44:57.573273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 844/1709] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:57.677446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d97863aa-eae3-448f-ac90-fceae5f6a940 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments/200ef7df-7141-4681-92ae-ce1b4bf58790" status: 202 len: 0 microversion: 2.20 time: 0.591376 Aug 23 22:44:57.678072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 866/1710] 10.222.0.73 () {60 vars in 1457 bytes} [Tue Aug 23 22:44:57 2022] DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments/200ef7df-7141-4681-92ae-ce1b4bf58790 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:44:57.686735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:57.689129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:57.695895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.696413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.696994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.697722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.698222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.698653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.728619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b282fe4a-49ea-46cf-8d13-e5780ef12c71 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045922 Aug 23 22:44:57.729206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 845/1711] 10.222.0.73 () {60 vars in 1343 bytes} [Tue Aug 23 22:44:57 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:44:57.749442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:57.751679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:57.758803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.759353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.759785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.760475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.760953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.761404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.792324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:57.792918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:57.793496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8d514026-d67a-4b5f-b222-6f37f36e27b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048066 Aug 23 22:44:57.794063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 867/1712] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:44:57.799552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.800028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.800458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.801173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:57.801619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:57.802043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:57.828063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:44:57.834939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.compute.api [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Working on deleting snapshot 0c97d9ae-2d7d-43cb-878c-d206af038cf8 from shelved instance... Aug 23 22:44:58.585791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:58.588031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:58.594694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:58.595184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:58.595617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:58.596384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:58.596769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:58.597215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:58.628082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0d8800f0-d2ef-4013-8c2b-77b532d11d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 23 22:44:58.632959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 868/1713] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:58.805903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:58.808097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:58.815453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:58.816053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:58.816744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:58.817485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:58.817940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:58.818369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:58.836888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:44:58.850044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fdc55152-05df-417b-af5f-24f3df04fde0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048193 Aug 23 22:44:58.850609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 869/1714] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:59.118940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Doing local delete in cell 50e9abbb-8f95-4d24-95a3-13ba3d95fa34(cell1) {{(pid=121885) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 23 22:44:59.119567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:59.120041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:59.120474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:59.120897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.compute.api [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 23 22:44:59.123332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [06f42851-af03-4cc9-a5e1-ac07a9143daa] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 22:44:59.640239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:59.642690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:59.649561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:59.650049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:59.650486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:59.651175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:59.651624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:59.652049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:59.684155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-086b9c1c-fa9f-4691-a06c-0e0ea40c3b7f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048063 Aug 23 22:44:59.684776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 870/1715] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:44:59.862947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:44:59.865160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:44:59.871320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:59.871802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:59.872240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:59.872932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:44:59.873418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:44:59.873842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:44:59.904521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b6cd0a10-2716-4989-ace9-f7785c0a5ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Aug 23 22:44:59.905136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 871/1716] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:44:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:00.131016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [06f42851-af03-4cc9-a5e1-ac07a9143daa] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50180. Aug 23 22:45:00.136438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] deallocate_for_instance() {{(pid=121885) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 23 22:45:00.698314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:00.700699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:00.707240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:00.707722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:00.708162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:00.708854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:00.709396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:00.709823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:00.739879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a2a3d93b-e0c8-42ce-b6f9-4602b5115098 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 23 22:45:00.740472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 872/1717] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:00.918054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:00.920284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:00.927975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:00.928557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:00.929238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:00.930104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:00.930555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:00.930976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:00.964837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f6800467-62b2-4539-b252-1ab16502fb37 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050932 Aug 23 22:45:00.965456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 873/1718] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:01.150732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4822c04-cfe2-4f63-b2db-42c5011791cc", "name": "network-vif-deleted", "tag": "5c6bb5ba-892a-4226-aaf9-01d9d08525ab"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:01.160937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Updating instance_info_cache with network_info: [] {{(pid=121885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 22:45:01.161462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:01.161795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:01.162681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:01.175291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.compute.server_external_events [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] Unable to find a host for instance e4822c04-cfe2-4f63-b2db-42c5011791cc. Dropping event network-vif-deleted {{(pid=121884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 22:45:01.176105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-38002b58-9203-49a4-a4f4-6455023960ee req-9e72924d-7a12-47f1-b52c-802264669ed7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.086447 Aug 23 22:45:01.176700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 874/1719] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 22:45:01.628836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.scheduler.client.report [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Deleted allocations for instance e4822c04-cfe2-4f63-b2db-42c5011791cc Aug 23 22:45:01.753037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:01.755694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:01.761395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:01.761960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:01.762461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:01.763631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:01.763755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:01.764270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:01.796683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e4f1dc98-8afb-4291-875e-366187572e38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Aug 23 22:45:01.797830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 875/1720] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:01.977074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:01.979312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:01.994077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:01.994077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:01.994077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:01.994077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:01.994971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:01.994971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:01.995895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-90f4f4d0-055f-402f-b666-a41b29e5b190 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 204 len: 0 microversion: 2.20 time: 4.207295 Aug 23 22:45:01.996490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 846/1721] 10.222.0.73 () {60 vars in 1280 bytes} [Tue Aug 23 22:44:57 2022] DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 0 bytes in 4209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 22:45:02.005454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:02.006171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:02.016419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:02.022428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:02.022428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:02.022428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:02.022428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:02.023084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:02.025809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6c8af327-5311-449f-9e26-34a739358c9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052822 Aug 23 22:45:02.026609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 876/1722] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:02.034832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc HTTP/1.1 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:45:02.036546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 22:45:02.038449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'e4822c04-cfe2-4f63-b2db-42c5011791cc'} Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:45:02.039397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 22:45:02.041082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:45:02.042432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:45:02.042432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ed778899-4610-4f67-90fb-9121fc7c300b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 404 len: 111 microversion: 2.20 time: 0.036793 Aug 23 22:45:02.042432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 847/1723] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:01 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:45:02.051891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-14c64aa8-8dfc-49f4-8430-dc1447b78e0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '.version_select at 0x7f5ed0d64310>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:02.130612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-14c64aa8-8dfc-49f4-8430-dc1447b78e0d tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88331809" status: 204 len: 0 microversion: 2.20 time: 0.082536 Aug 23 22:45:02.131326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 877/1724] 10.222.0.73 () {60 vars in 1256 bytes} [Tue Aug 23 22:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88331809 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:45:02.809746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:02.812401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:02.819357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:02.819849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:02.820294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:02.821050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:02.821541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:02.823855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:02.856087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a068c7d5-8503-4564-b04b-8ca4b7cd5c96 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051168 Aug 23 22:45:02.861291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 848/1725] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:03.040425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:03.042810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:03.045792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3fb60130-3d70-42e7-b03c-6da10370725b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'create', calling method: .version_select at 0x7f5ed5799700>, body: {"keypair": {"name": "tempest-keypair-1990070681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgVkmQmUq/UXsKfgWMQ5BfZrGxJnyl5+flFQN+FoUJBZaMTYBfWHzu3Jx7sVm2zsbCBTydnFXXKw61WOsE3H88/TZQNg4SHyn8N/f9SPWEB86re5xlKPafCZYbFmFQPTw=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:03.050560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:03.050976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:03.051478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:03.052203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:03.052688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:03.053198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:03.072994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-3fb60130-3d70-42e7-b03c-6da10370725b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:45:03.072994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-3fb60130-3d70-42e7-b03c-6da10370725b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for user 3eda1fca08b24727929b63318fd6f13e and project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:45:03.086519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1ee6092d-2154-4710-ad28-7f9adada70d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050977 Aug 23 22:45:03.087351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 878/1726] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:03.164678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3fb60130-3d70-42e7-b03c-6da10370725b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.122869 Aug 23 22:45:03.165317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 849/1727] 10.222.0.73 () {62 vars in 1200 bytes} [Tue Aug 23 22:45:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 22:45:03.869262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:03.871425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:03.878579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:03.879146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:03.879593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:03.880299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:03.880766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:03.881232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:03.919015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ecb2d8b1-a48d-4cc6-bb10-f739236ba548 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053329 Aug 23 22:45:03.919695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 879/1728] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:04.100674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:04.103167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:04.110352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:04.112699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:04.112699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:04.112699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:04.112699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:04.113091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:04.115352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:04.146524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8ba49ee8-f53c-4654-928f-9ea5377266a6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050834 Aug 23 22:45:04.147061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 850/1729] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:04.932036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:04.934218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:04.941580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:04.942072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:04.942506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:04.943217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:04.943813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:04.944232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:04.976462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-43d5c83c-571a-4c40-b85a-7473631fce56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048396 Aug 23 22:45:04.977151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 880/1730] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:05.158654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:05.160899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:05.168317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:05.168809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:05.169288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:05.170036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:05.170575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:05.171006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:05.205111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a775ee7b-46d8-43c8-9eaa-fb82776598b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050527 Aug 23 22:45:05.205639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 851/1731] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:05.404270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1056193724", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0519581-2335-4850-af7a-c7665f17e04b"}], "security_groups": [{"name": "tempest-securitygroup--1555280337"}], "key_name": "tempest-keypair-1990070681", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:05.510041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] validate_networks() for [('d0519581-2335-4850-af7a-c7665f17e04b', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:45:05.949274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:45:05.949274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:45:05.949274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:45:05.949274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:45:05.949274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:45:05.956622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:05.957144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:05.957586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:05.958317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:05.958777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:05.959195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:05.976578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:45:05.982166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Getting quotas for user 3eda1fca08b24727929b63318fd6f13e and project b02af2d33ca74bd08365dfc34a6fa77a. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:45:05.989580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:05.991744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:05.992533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:45:05.994883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:45:05.997989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:05.998476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:05.998913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:05.999604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:06.000096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:06.000797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:06.041680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-598b4a13-f1e0-4c09-b23c-74f1a69d4a08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056268 Aug 23 22:45:06.042237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 852/1732] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:06.194147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-51154fe7-ba28-49a0-8a14-bf3ee6b22e76 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.794166 Aug 23 22:45:06.194767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 881/1733] 10.222.0.73 () {62 vars in 1188 bytes} [Tue Aug 23 22:45:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 22:45:06.206449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:06.207219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:06.217527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:06.220332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:06.230182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:06.231083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:06.231083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:06.231964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:06.232449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:06.232877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:06.267957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:06.268527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d51a1789-c886-4f8d-91f8-103c8bd421fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054923 Aug 23 22:45:06.273472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 882/1734] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:06.276644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:06.278173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:06.279279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca2ff3e2-5aa5-4556-9d52-412837211b66 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1282 microversion: 2.20 time: 0.077416 Aug 23 22:45:06.279823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 853/1735] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:06 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:07.054291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:07.056557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:07.063581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.064023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.064583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.065353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.065806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.066484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.096340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b9133f91-45c9-4d5b-9dc7-e8712a0cbc81 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Aug 23 22:45:07.096915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 883/1736] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:07.280766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:07.283653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:07.290989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.291476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.291917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.292608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.293084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.293512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.301071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:07.301758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:07.310538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.311433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.312670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.313957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:07.314660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:07.315521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:07.325886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1273495d-2a2b-4aa6-b20d-b005b5134e78 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Aug 23 22:45:07.326474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 854/1737] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:07.382195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:07.390307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:07.392393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:07.393530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ca77ccd6-2374-4250-930f-503a80b84716 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1286 microversion: 2.20 time: 0.096597 Aug 23 22:45:07.394083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 884/1738] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:07 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:45:08.108535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:08.110701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:08.117496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.117970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.118423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.119084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.119530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.120272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.149531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d697fd8a-298a-49a4-970a-8cb84c4cac51 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Aug 23 22:45:08.150294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 855/1739] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:08.340082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:08.342304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:08.349923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.350418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.350848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.351748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.352207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.352641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.389784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a5bdf70-1da9-410d-b986-3d1f71778b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053752 Aug 23 22:45:08.394611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 885/1740] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:08.416254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:08.416869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:08.424422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.425311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.425759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.426502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:08.426957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:08.427605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:08.511051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:08.523245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:08.524849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:08.527124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa75bf45-b9da-4da6-a1e8-2fadb96de0ce tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1342 microversion: 2.20 time: 0.114931 Aug 23 22:45:08.527884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 856/1741] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:08 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:09.162847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:09.166685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:09.174331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.174879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.175316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.176795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.176795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.177082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.212831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-09bfab48-531a-434d-b917-4353254d0b84 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053879 Aug 23 22:45:09.213858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 886/1742] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:09.402452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:09.404815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:09.412607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.413706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.413924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.414789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.415474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.415997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.450013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45e6ebf8-42df-411b-9449-de23939b3120 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Aug 23 22:45:09.453666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 857/1743] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:09.556742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:09.559602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:09.567308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.567792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.568217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.568916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:09.569386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:09.570700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:09.707476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:09.716649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:09.719293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:09.719693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dda7c878-17aa-43a5-9543-4fe22598aeb3 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.168918 Aug 23 22:45:09.720464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 887/1744] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:09 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:10.226082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:10.228674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:10.235453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.235935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.236567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.237472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.237932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.238357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.269628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-96f0a8c8-7c75-4d1a-8895-c66820ffaa1e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 23 22:45:10.270255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 858/1745] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:10.362211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182af6e4-420a-41c2-90ea-a10069ce20af", "tag": "2bede4e3-6eb7-465b-ad53-8d5dd479f509"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:10.372470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.372922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.373386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.390004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] Creating event network-changed:2bede4e3-6eb7-465b-ad53-8d5dd479f509 for instance 182af6e4-420a-41c2-90ea-a10069ce20af on hv-cinder-84254 Aug 23 22:45:10.391941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-2579deb1-952f-4bac-9dee-183be060626a req-a5d8fff5-1eb1-4a41-b800-6415f67f5e1d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Aug 23 22:45:10.392715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 888/1746] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:10.464676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:10.467528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:10.475247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.475734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.476218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.476917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.477399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.477826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.508800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-32eb24c0-1dd3-4f00-8302-78159ca990b1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Aug 23 22:45:10.509415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 859/1747] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:10.749540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:10.752561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:10.757611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.758094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.758531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.759228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:10.759673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:10.760096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:10.764403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:10.897522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:10.907999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:10.909604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:10.910823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8915fd8a-5772-40f4-ab2b-4085a3c7a6be tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.166172 Aug 23 22:45:10.911583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 889/1748] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:10 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:11.283761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:11.285878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:11.291866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.292349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.292787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:11.293514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.293967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.294392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:11.325525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-59dcc5a0-b8b9-4889-aee5-43f8b447e00c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Aug 23 22:45:11.326087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 860/1749] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:11.522222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:11.524428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:11.530332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.530805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.531741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:11.532596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.533060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.533479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:11.565286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-72002f6a-d06d-4597-8b3f-95d924cc6c97 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 23 22:45:11.566115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 890/1750] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:11.933668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:11.934266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:11.941234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.941708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.942132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:11.942812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:11.943255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:11.943669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:12.081218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:12.089714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:12.091209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:12.092297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8416eb39-0bab-45a5-8ee1-99d0ca53c26b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.162513 Aug 23 22:45:12.092843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 861/1751] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:11 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:12.338689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:12.340763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:12.347433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:12.347920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:12.348357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:12.349081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:12.349561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:12.349986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:12.379652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd9e73e1-1864-4570-8b5a-4a123a9a2063 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Aug 23 22:45:12.380210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 891/1752] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:12.578387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:12.580627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:12.587454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:12.587935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:12.588386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:12.589256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:12.589724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:12.590152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:12.621356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-19267492-efef-4478-8f14-480e23317831 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047003 Aug 23 22:45:12.621914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 862/1753] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:13.117718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:13.118329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:13.124347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.124828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.125293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.125988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.126436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.126858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.260573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:13.269853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:13.271273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:13.272365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c49a0cd4-83e8-46a9-add2-11d405755286 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.160110 Aug 23 22:45:13.272919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 892/1754] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:13 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:13.392148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:13.395016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:13.401639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.402117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.402550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.403240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.403695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.404107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.434022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-833fdf47-eb8c-489b-8b86-2e34f658a9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Aug 23 22:45:13.434570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 863/1755] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:13.634532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:13.636683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:13.643815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.644302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.644738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.645469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:13.645924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:13.646348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:13.676497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1d2926fa-9efa-4357-846b-3dfe4358aa74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 23 22:45:13.677080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 893/1756] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:14.295585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:14.296211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:14.304351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.306195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.306646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.307363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.307822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.308234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.446412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:14.450047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:14.455369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:14.458590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.459469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.459915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.460626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.463177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.463629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.465740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:14.467353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:14.469387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f9475b08-23e6-4e5f-bd34-57d846e82924 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.177511 Aug 23 22:45:14.470259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 864/1757] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:14 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:45:14.510643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c341255e-731b-4587-84e8-3a114b3f3d19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068810 Aug 23 22:45:14.511456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 894/1758] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:14.691163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:14.693367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:14.700418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.700904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.701403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.702071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:14.702593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:14.703184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:14.739497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-35b1eb71-7fa5-4c21-b70f-724b40636bc8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053934 Aug 23 22:45:14.740047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 865/1759] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:15.495542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:15.496180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:15.502837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.503326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.503766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.504462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.504920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.505379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.527036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:15.532856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:15.542585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.543211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.543866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.544770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.545250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.545670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.578205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-744f5336-6807-4036-affc-cab4bdfb8d08 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057616 Aug 23 22:45:15.578961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 866/1760] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:15.668030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:15.676426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:15.677952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:15.679059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b791ee9f-0639-43b2-8cd2-c922960759c8 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.190212 Aug 23 22:45:15.679617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 895/1761] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:15 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:15.752372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:15.754450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:15.760394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.760912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.761334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.762022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:15.762466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:15.762887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:15.790118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:15.794926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-195077c2-d7d3-4a45-a847-69fed618f069 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Aug 23 22:45:15.795494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 867/1762] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:16.590528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:16.592705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:16.595018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:16.595718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:16.600994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.601521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.602002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.602682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.603137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.603562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.635198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6821e34b-58e1-4c3f-9786-66e6ee092bc8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 Aug 23 22:45:16.635757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 896/1763] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:16.703227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:16.704078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:16.706104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:16.711605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.712097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.712541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.713310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.713766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.714198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.856717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:16.859728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182af6e4-420a-41c2-90ea-a10069ce20af", "name": "network-vif-plugged", "status": "completed", "tag": "2bede4e3-6eb7-465b-ad53-8d5dd479f509"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:16.868440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:16.869982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:16.870162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.870649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.871100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6c1a12b0-e454-4fcb-aaba-571b6ebf9db9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.172959 Aug 23 22:45:16.871218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.871916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 868/1764] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:16 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:16.876431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:16.878583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:16.884913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.885476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.886138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.887172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:16.888180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:16.889145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:16.902226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] Creating event network-vif-plugged:2bede4e3-6eb7-465b-ad53-8d5dd479f509 for instance 182af6e4-420a-41c2-90ea-a10069ce20af on hv-cinder-84254 Aug 23 22:45:16.908748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-4d45f146-e81b-467e-8b36-0ff8a4b3eef2 req-177f29fd-8c32-482b-89be-4f7325323a04 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109324 Aug 23 22:45:16.909373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 897/1765] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:16.930045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1f72948a-b40e-4c6e-b26e-0c11f796c62e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057327 Aug 23 22:45:16.930616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 869/1766] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:17.648174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:17.650364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:17.657682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.658223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.658595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.659284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.659730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.660147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.691433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-721695b2-1aac-47b4-8ab5-eafa3d77e62f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Aug 23 22:45:17.691982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 898/1767] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:17.898414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:17.899011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:17.905414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.907153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.907598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.908294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.908752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.909220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.942443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:17.944830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:17.946849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:17.951545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.952036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.953078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.953969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:17.954425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:17.954855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:17.985998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2cf12f6c-8634-40da-b1bb-b0d00bd095bb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047948 Aug 23 22:45:17.986581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 899/1768] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:18.048034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:18.058606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:18.060305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:18.061646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a987ef4b-04bb-418b-a01b-2aef731f3e12 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.167256 Aug 23 22:45:18.062344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 870/1769] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:17 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:18.704421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:18.706801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:18.713599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:18.714084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:18.714508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:18.715202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:18.715646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:18.716063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:18.748490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-47c363de-68b1-49a1-ba76-263a3bd42459 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048619 Aug 23 22:45:18.750163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 900/1770] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:18.998105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:19.000793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:19.007373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.013768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.013768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.013768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.013768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.014199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.040821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b2a1108c-fcbf-4f38-ba57-c61e88c44e5f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046589 Aug 23 22:45:19.041405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 871/1771] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:19.086605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:19.087310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:19.094715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.095122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.095558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.096270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.096722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.097207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.238957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:19.247570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:19.249201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:19.250487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-db0116b3-35b8-4ee8-82af-09c51e4f63e9 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1408 microversion: 2.20 time: 0.167858 Aug 23 22:45:19.251776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 901/1772] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:19 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:45:19.761770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:19.763902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:19.770023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.770507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.770946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.771634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:19.772088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:19.772509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:19.805265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3232859a-e866-4d72-81f0-e6bfc16657c9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Aug 23 22:45:19.805830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 872/1773] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:20.053305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:20.055585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:20.062264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.062751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.063214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.064064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.064522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.064944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.096244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4c8bc08-ad7c-4763-875f-48be84b464fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Aug 23 22:45:20.096733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 902/1774] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:20.280886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:20.281574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:20.284068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:20.289191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.289677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.290137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.290798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.291242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.291697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.430322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:20.439794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:20.441603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:45:20.443107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a40a1e26-f3b6-4988-b690-9590bb740758 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1601 microversion: 2.20 time: 0.166495 Aug 23 22:45:20.443338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 873/1775] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:45:20 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:45:20.467775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:20.467775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:20.474246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.476373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.476819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.478673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.478673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.478673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.569773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4023bebb-c930-41b0-a4a5-6b7ade550484 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107372 Aug 23 22:45:20.570377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 903/1776] 10.222.0.73 () {60 vars in 1316 bytes} [Tue Aug 23 22:45:20 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:45:20.818401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:20.820619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:20.826532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.827021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.827946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.829063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:20.829525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:20.829957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:20.860126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-714b3753-24e3-49b3-81b4-16b93cbc08b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 23 22:45:20.860829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 874/1777] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:21.109824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:21.112394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:21.118855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:21.119352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:21.119792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:21.120503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:21.120983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:21.121448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:21.153258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7c26ff2b-a0af-4ecf-9eb7-314c4797475b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Aug 23 22:45:21.154056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 904/1778] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:21.868990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182af6e4-420a-41c2-90ea-a10069ce20af", "tag": "2bede4e3-6eb7-465b-ad53-8d5dd479f509"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:45:21.875971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:21.878226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:21.879659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:21.880140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:21.880571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:21.884222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:21.884649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:21.885103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:21.885793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:21.886239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:21.886661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:21.892741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] Creating event network-changed:2bede4e3-6eb7-465b-ad53-8d5dd479f509 for instance 182af6e4-420a-41c2-90ea-a10069ce20af on hv-cinder-84254 Aug 23 22:45:21.898220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-bde9afe7-bca4-4a98-bdbd-19475b04be4a req-572fc0fe-3dfa-4fb9-8c1c-1c4c1a2d9891 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089009 Aug 23 22:45:21.899084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 875/1779] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:21.918124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8309d2b8-fdf4-47b9-8170-544f970d2e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Aug 23 22:45:21.918798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 905/1780] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:22.168432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:22.171625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:22.178249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:22.178735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:22.179164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:22.179863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:22.180341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:22.180759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:22.212678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c493233c-5ae2-4aa3-8f28-bbf0f21fe774 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049379 Aug 23 22:45:22.213575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 876/1781] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:22.933263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:22.935359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:22.943378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:22.943865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:22.944334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:22.945062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:22.945519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:22.945948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:22.973274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:22.978204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4ad75f35-6030-49de-9b8f-f40ed3e1595a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049051 Aug 23 22:45:22.978776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 906/1782] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:23.225835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:23.227993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:23.235128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:23.235612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:23.236047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:23.236785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:23.237271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:23.237699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:23.268350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4200324f-7a36-4656-a771-65de9a7566f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Aug 23 22:45:23.268912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 877/1783] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:23.989999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:23.992156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:23.999126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:23.999611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:24.000143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:24.000902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:24.001384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:24.001814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:24.031879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1a22b13-7954-42fb-bb8e-c0dd63d0760a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Aug 23 22:45:24.032449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 907/1784] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:24.280080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:24.282701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:24.289308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:24.289796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:24.290235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:24.290958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:24.291414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:24.291835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:24.322455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e5621c0-811d-4197-b417-e62dd63d518e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Aug 23 22:45:24.323014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 878/1785] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:25.044106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:25.046918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:25.053385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:25.058696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:25.058696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:25.058696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:25.058696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:25.059210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:25.087061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-92588a7b-13b0-4023-b6f4-cca1dc5abd30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 23 22:45:25.087641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 908/1786] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:25.334865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:25.337001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:25.344344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:25.344817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:25.345266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:25.345946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:25.346386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:25.346802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:25.374693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-02a03b55-992e-46ad-8824-190248acbbff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Aug 23 22:45:25.375236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 879/1787] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:26.100096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:26.102531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:26.109850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:26.110298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:26.110740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:26.111452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:26.111910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:26.112331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:26.142886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f4d7357-f6e6-42d2-b58b-f51db6bb72a0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046780 Aug 23 22:45:26.144089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 909/1788] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:26.386812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:26.388839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:26.395426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:26.395949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:26.396355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:26.397059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:26.397551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:26.397988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:26.430834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-884cc9d9-1653-45fc-b445-13c0ed8f0cd3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Aug 23 22:45:26.431879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 880/1789] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:27.156518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:27.158630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:27.165232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:27.165741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:27.166178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:27.166870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:27.167322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:27.167742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:27.199049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7829cacc-67fe-48bf-9c2e-e872400838c3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047541 Aug 23 22:45:27.199618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 910/1790] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:27.446803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:27.448926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:27.456649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:27.457172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:27.457613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:27.458323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:27.458774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:27.459198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:27.489042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9e928aef-bdbc-496f-9fcb-05d99888867d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Aug 23 22:45:27.489612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 881/1791] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:28.211889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:28.214114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:28.220703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:28.221221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:28.221652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:28.222332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:28.222777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:28.223192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:28.253074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bcd6bd8b-de7d-4ccd-8955-2761d3afa3fc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Aug 23 22:45:28.253637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 911/1792] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:28.501248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:28.503365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:28.510173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:28.510657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:28.511098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:28.511782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:28.512233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:28.512654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:28.542900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b6244c81-7a22-4864-a257-7b43179790c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Aug 23 22:45:28.543466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 882/1793] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:29.266284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:29.268445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:29.274958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:29.275437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:29.275867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:29.276556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:29.276999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:29.277499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:29.307461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f396014-8e41-4488-9873-30e12a810862 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Aug 23 22:45:29.308026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 912/1794] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:29.556032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:29.558177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:29.565251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:29.565797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:29.566238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:29.566966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:29.567421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:29.567848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:29.598161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0ca0151c-b545-4cbf-821a-ec7e970941f3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 23 22:45:29.598735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 883/1795] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:30.320720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:30.322907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:30.329684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:30.330106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:30.330539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:30.331233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:30.331715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:30.332141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:30.361183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d69295e8-1e44-4bdd-80a4-b3d692691e86 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Aug 23 22:45:30.361743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 913/1796] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:30.611318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:30.613543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:30.619984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:30.620470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:30.620907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:30.621689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:30.622145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:30.622626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:30.653105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6e26f5e-31c7-46c7-b602-e7aae382bcc9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Aug 23 22:45:30.653778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 884/1797] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:31.374287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:31.376461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:31.382888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:31.383381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:31.383820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:31.384545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:31.384995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:31.385441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:31.415540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7823aab2-6c5d-4207-bcfb-745da058be6a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Aug 23 22:45:31.416094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 914/1798] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:31.666671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:31.668700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:31.675960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:31.676448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:31.676886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:31.677614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:31.678067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:31.678492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:31.682226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:31.708744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c5e30bd3-8d8e-4289-812d-8e46429ec775 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Aug 23 22:45:31.709345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 885/1799] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:45:32.427263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:32.429395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:32.435752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:32.436873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:32.437412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:32.438098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:32.438545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:32.438959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:32.477728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c50206c8-bb58-44cd-9842-4edbbb06f387 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Aug 23 22:45:32.477728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 915/1800] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:32.721633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:32.723766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:32.730640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:32.731059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:32.731485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:32.732167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:32.732612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:32.733687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:32.761501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f1b50326-0a4e-4817-ab62-3376a1314deb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Aug 23 22:45:32.762057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 886/1801] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:33.488158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:33.490409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:33.496943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:33.497464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:33.497901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:33.499107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:33.499558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:33.499984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:33.530313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cd422bd3-f499-4440-8773-a11429058d74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 23 22:45:33.530888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 916/1802] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:33.774538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:33.776855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:33.784979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:33.785479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:33.785942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:33.786649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:33.787102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:33.787523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:33.817431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-51ec77b4-ac55-49de-993e-364e02033189 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Aug 23 22:45:33.818016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 887/1803] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:34.542283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:34.544374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:34.551112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:34.551608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:34.552053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:34.552845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:34.553340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:34.553774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:34.586269 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7f0c0a8-17bc-44ec-86e0-36d95f6fbdaa tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Aug 23 22:45:34.586829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 917/1804] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:34.831000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:34.833065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:34.839628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:34.840094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:34.840535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:34.841273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:34.841731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:34.842197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:34.878363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4b97c15-8d21-4e45-917c-5787e939f1e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052415 Aug 23 22:45:34.878930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 888/1805] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:35.598556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:35.600705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:35.607058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:35.607553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:35.608111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:35.608877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:35.609368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:35.609785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:35.638251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7a8510e6-aa4f-4f9c-88a9-90c15a74f0d4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Aug 23 22:45:35.638797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 918/1806] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:35.891531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:35.893754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:35.900273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:35.900759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:35.901851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:35.902670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:35.903190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:35.903622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:35.933668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fec81abb-484d-4763-b91c-2566b20b4260 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Aug 23 22:45:35.934242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 889/1807] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:36.651680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:36.653753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:36.660461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:36.660950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:36.661421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:36.662119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:36.662612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:36.663035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:36.693464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a8d8ae4-f518-4722-bbeb-f7f2748cdad9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046097 Aug 23 22:45:36.694041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 919/1808] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:36.947733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:36.950140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:36.958110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:36.958624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:36.959054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:36.959747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:36.960291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:36.960720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:36.990767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-999375c7-0815-48f5-9851-2c17172f36ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Aug 23 22:45:36.991342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 890/1809] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:37.706521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:37.708652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:37.715159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:37.715749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:37.716231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:37.716975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:37.718061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:37.718477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:37.749089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d91a81ef-6a00-4f27-973c-42d2d8864544 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Aug 23 22:45:37.749665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 920/1810] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:38.003217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:38.005277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:38.012031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:38.012499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:38.012926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:38.013639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:38.014575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:38.014988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:38.043707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1f9829e5-6da8-44c8-9fbe-946ac3496b80 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 23 22:45:38.044259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 891/1811] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:38.761654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:38.763983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:38.770813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:38.771399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:38.771840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:38.772538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:38.772998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:38.773443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:38.806007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0490e21e-c101-4f7b-af59-64577b34fa99 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048842 Aug 23 22:45:38.806570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 921/1812] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:39.056319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:39.058438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:39.065543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:39.066041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:39.066479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:39.067173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:39.067624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:39.068048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:39.097909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-202e9559-1af5-474d-b397-ea316947e559 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 23 22:45:39.098474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 892/1813] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:39.818567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:39.820618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:39.827674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:39.828607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:39.828607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:39.829263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:39.829739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:39.830128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:39.859654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd66ac5e-fcf4-480f-bc1b-e6046fa6d788 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Aug 23 22:45:39.860212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 922/1814] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:40.111268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:40.113341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:40.119851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:40.120337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:40.120776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:40.121507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:40.121961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:40.122386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:40.152364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a3b6f961-9a5e-4694-a8c9-8c13f4056d93 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046601 Aug 23 22:45:40.152928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 893/1815] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:40.872063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:40.874278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:40.880613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:40.881134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:40.881578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:40.882268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:40.882718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:40.883198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:40.901081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:40.915014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f01a0644-572e-453c-9b0e-669d2d43ee6e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Aug 23 22:45:40.915616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 923/1816] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:41.165275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:41.167338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:41.173823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:41.174302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:41.174738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:41.175420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:41.175869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:41.176283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:41.212442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5f8f5c62-ceb8-490b-b060-fdd169f2be0c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051139 Aug 23 22:45:41.213001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 894/1817] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:41.928330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:41.930535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:41.938167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:41.938649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:41.939085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:41.940065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:41.940513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:41.940932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:41.971222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a87691e8-fd2c-48f1-9894-8daa013cecec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046942 Aug 23 22:45:41.971775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 924/1818] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:42.224543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:42.226708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:42.233656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:42.234228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:42.234650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:42.235361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:42.235817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:42.236242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:42.267483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f1c55418-f6fc-4895-bcb6-97b7e8740cdd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046918 Aug 23 22:45:42.268096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 895/1819] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:42.984065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:42.986266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:42.992735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:42.993258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:42.993696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:42.994388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:42.994837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:42.995259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:43.024687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cabadad5-69d9-4615-a940-c31e84fe5e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 23 22:45:43.025272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 925/1820] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:43.281183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:43.283373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:43.290053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:43.290596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:43.291056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:43.291765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:43.292220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:43.292647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:43.323529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7a362e6-92c7-47fb-a4f4-710849848ee5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047263 Aug 23 22:45:43.324115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 896/1821] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:44.037231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:44.039417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:44.046601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:44.047082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:44.047516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:44.048203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:44.048655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:44.049100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:44.080168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02e398dc-79c8-4450-9715-841793a69bf0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Aug 23 22:45:44.080659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 926/1822] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:44.336881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:44.338978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:44.346105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:44.346620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:44.347057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:44.347748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:44.348202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:44.348634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:44.377607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ee51c575-07b9-41c0-b04f-144cacca6024 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Aug 23 22:45:44.378171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 897/1823] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:45.092147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:45.094395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:45.101162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:45.101660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:45.102107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:45.102815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:45.103268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:45.103698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:45.134208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-68f2d186-338e-4130-a936-906c6015b992 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Aug 23 22:45:45.134683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 927/1824] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:45.390123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:45.392160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:45.398548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:45.399026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:45.399460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:45.400148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:45.400602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:45.401046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:45.429476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-575f660a-c1b0-49cc-b754-f86dc8baf2de tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 23 22:45:45.430031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 898/1825] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:46.147479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:46.149590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:46.157279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:46.157769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:46.158203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:46.158905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:46.159355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:46.159773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:46.190663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-addc2dbe-d9cb-451b-861d-3cdb10aed78e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047354 Aug 23 22:45:46.191695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 928/1826] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:46.443239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:46.445349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:46.452815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:46.453368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:46.453807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:46.454506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:46.454962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:46.455390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:46.489727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9e69ed00-4832-4595-bd6f-c2b6f72044c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050844 Aug 23 22:45:46.490305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 899/1827] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:47.202292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:47.204443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:47.210946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:47.211448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:47.211878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:47.212561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:47.213025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:47.213454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:47.243310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a52a046-165b-44fd-b1fb-89dcfa94f284 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Aug 23 22:45:47.243783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 929/1828] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:47.502447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:47.504455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:47.510579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:47.511077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:47.511541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:47.512242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:47.512625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:47.513078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:47.542207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f3bd23f8-d6f0-4d6d-b0b0-87bec4b850ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 23 22:45:47.542758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 900/1829] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:48.255703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:48.257882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:48.264573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:48.265112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:48.265555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:48.266249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:48.266707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:48.267129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:48.297222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c4beaf4e-64dc-41eb-8376-591c08fccdbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Aug 23 22:45:48.297779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 930/1830] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:48.554960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:48.557143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:48.564516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:48.565003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:48.565470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:48.566171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:48.566623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:48.567047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:48.592301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:48.596925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-475c3085-bb45-487e-a5c2-8c66d303df9c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Aug 23 22:45:48.597583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 901/1831] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:49.309712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:49.312660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:49.315519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=64 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:49.320522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:49.321141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:49.321617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:49.322378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:49.322874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:49.323382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:49.356409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0363a9ba-9ec5-4bee-8b9e-a0c9381e8930 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050589 Aug 23 22:45:49.356890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 931/1832] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:49.623304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:49.625421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:49.632212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:49.632698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:49.633170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:49.633863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:49.634364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:49.634791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:49.674353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-687abbac-cc57-4506-81dd-5dc80382950c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055146 Aug 23 22:45:49.674922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 902/1833] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:50.369287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:50.371422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:50.378527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:50.379015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:50.379463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:50.380157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:50.380614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:50.381062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:50.410183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-989ffd5e-39e7-49bc-97b3-6a900346f263 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Aug 23 22:45:50.410663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 932/1834] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:50.687767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:50.690489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:50.693145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=60 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:50.697835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:50.698352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:50.698789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:50.699458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:50.699900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:50.700314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:50.729628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-face2db1-2f72-4182-8988-776ea6800529 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Aug 23 22:45:50.730188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 903/1835] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:51.422588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:51.424749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:51.431178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:51.431665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:51.432113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:51.432802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:51.433285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:51.433711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:51.464880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ba75c1d-556e-4180-aa11-b4517384e3ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Aug 23 22:45:51.465400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 933/1836] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:51.742616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:51.744901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:51.752484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:51.752969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:51.753462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:51.754159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:51.754614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:51.755040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:51.784180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45afbad3-3eae-46e6-b734-4fddd819ada6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Aug 23 22:45:51.784738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 904/1837] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:52.478078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:52.480221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:52.487304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:52.487791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:52.488223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:52.488911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:52.489382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:52.489795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:52.520125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c28ee6af-9305-42c0-a814-f20d57f7c0cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Aug 23 22:45:52.520685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 934/1838] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:52.797324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:52.799516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:52.806158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:52.806679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:52.807118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:52.807865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:52.808266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:52.808749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:52.838929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a1254002-a279-4095-a7ac-08476c741e74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Aug 23 22:45:52.839526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 905/1839] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:53.533345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:53.536009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:53.543363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:53.543886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:53.544418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:53.545273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:53.545782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:53.546240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:53.578081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-03e6e61b-d3a1-4200-8c4f-efd4f167eae3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049646 Aug 23 22:45:53.578647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 935/1840] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:53.851522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:53.853670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:53.860824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:53.861348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:53.861780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:53.862466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:53.862913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:53.863333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:53.891862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5618a14d-20c0-49d6-8a4d-4a81219c1aca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 23 22:45:53.892417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 906/1841] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:54.589584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:54.592462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:54.598881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:54.599371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:54.599812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:54.600513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:54.600967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:54.601423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:54.633005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cec6bd8b-23ca-4b05-9a22-694449b94447 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047473 Aug 23 22:45:54.633602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 936/1842] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:54.905044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:54.907210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:54.913580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:54.914061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:54.914519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:54.915203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:54.915659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:54.916105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:54.947128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f03f0b5f-3dab-4e0e-b224-00eeb0ed0bb7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Aug 23 22:45:54.947709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 907/1843] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:55.646090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:55.648241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:55.655627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:55.656125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:55.656570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:55.657331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:55.657783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:55.658215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:55.689131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6e5bc91a-5534-4e03-afd9-eebfa2628e1c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046720 Aug 23 22:45:55.689710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 937/1844] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:55.960020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:55.962178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:55.969263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:55.969743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:55.970176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:55.970857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:55.971303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:55.971739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:56.000019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7db8a5c9-c5b0-460b-ad69-e29702146676 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Aug 23 22:45:56.000573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 908/1845] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:56.701742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:56.703935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:56.710414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:56.710892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:56.711324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:56.712009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:56.712454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:56.712868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:56.752834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c16459ff-efd8-4568-ab1f-956ef2de7577 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055250 Aug 23 22:45:56.753427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 938/1846] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:57.012482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:57.016107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:57.021706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:57.022192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:57.022637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:57.023395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:57.023930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:57.024358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:57.058466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9afe9567-1831-49b1-a69d-5dd47422ca13 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050025 Aug 23 22:45:57.059037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 909/1847] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:57.766258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:57.768440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:57.774873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:57.775359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:57.775798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:57.776494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:57.776944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:57.777400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:57.806765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2277a60b-efe0-48b7-8cc8-86eb86675670 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Aug 23 22:45:57.807381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 939/1848] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:58.071347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:58.073441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:58.080137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:58.080637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:58.081087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:58.081795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:58.082250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:58.082673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:58.112026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ef8cdddc-8985-4d81-9ff9-72824c6ac638 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Aug 23 22:45:58.112590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 910/1849] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:58.819139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:58.821335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:58.828790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:58.829304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:58.829734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:58.830426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:58.830869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:58.831282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:58.835294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:45:58.862776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-153adb9f-b02f-4421-a1ee-c63b6031b2ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047494 Aug 23 22:45:58.863450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 940/1850] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:59.124016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:59.126096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:59.132585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:59.133087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:59.133519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:59.134200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:59.134640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:59.135053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:59.164799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5809eff1-b4ef-4297-bfd6-69aff0b44389 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Aug 23 22:45:59.165387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 911/1851] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:45:59.875206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:45:59.877408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:45:59.883961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:59.884407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:59.884838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:59.885562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:45:59.886110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:45:59.886413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:45:59.918177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7748470c-6079-4e91-989a-f6411d73dee4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Aug 23 22:45:59.918585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 941/1852] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:45:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:00.177564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:00.179633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:00.186142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:00.186623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:00.187057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:00.187778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:00.188241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:00.188922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:00.219044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ee024221-01d2-4d55-adbe-df144f1809fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Aug 23 22:46:00.219600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 912/1853] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:00.930873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:00.933156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:00.940154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:00.940638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:00.941104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:00.941802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:00.942258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:00.942687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:00.975412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bdea4da5-d3b3-4a64-bd60-586e08f9cae8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Aug 23 22:46:00.976111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 942/1854] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:01.232218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:01.234559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:01.241068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:01.241559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:01.242000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:01.242683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:01.243136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:01.243627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:01.272951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-13d60c23-4d5d-4863-9897-7fd8b33f0d3b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Aug 23 22:46:01.273537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 913/1855] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:01.987645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:46:01.990027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:01.998497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:01.998497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:01.998497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:01.998497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:01.998908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:01.999176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:02.113922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-05cd264b-8ce9-4b1f-91b6-3ae5f20631d2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action" status: 200 len: 75988 microversion: 2.1 time: 0.129918 Aug 23 22:46:02.114509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 943/1856] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:46:01 2022] POST /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73/action => generated 75988 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:46:02.285364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:02.287526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:02.294178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:02.294826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:02.295265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:02.295964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:02.296420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:02.296847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:02.327408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5605fcbd-d231-455a-b0ac-f0c7cef4e265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Aug 23 22:46:02.327970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 914/1857] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:03.341749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:03.344010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:03.351026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:03.351507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:03.351947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:03.352640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:03.353120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:03.353545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:03.384707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-396b0312-853f-4b23-8d87-06db49b58cd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 Aug 23 22:46:03.385308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 944/1858] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:04.397266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:04.399295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:04.405730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:04.406205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:04.406631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:04.407310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:04.407751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:04.408173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:04.437204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-921a3a40-928c-446d-ae55-07313c06cf9a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Aug 23 22:46:04.437752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 915/1859] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:05.449027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:05.451335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:05.457860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:05.458347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:05.458789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:05.459523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:05.459975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:05.460426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:05.490704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ecd05b02-139d-4c87-bf85-196dfaaa5dd9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Aug 23 22:46:05.491270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 945/1860] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:06.503518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:06.505612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:06.512188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:06.513094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:06.513591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:06.514286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:06.514732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:06.515172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:06.544956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b4df4b02-3535-4572-94ca-b79efdae8a0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Aug 23 22:46:06.545582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 916/1861] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:07.558208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:07.560443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:07.567637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:07.568180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:07.568707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:07.569603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:07.570111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:07.570562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:07.600724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e857a333-bfea-4b20-97b4-8d8767c8dad8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Aug 23 22:46:07.601320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 946/1862] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:08.613653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:08.615718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:08.622539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:08.623064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:08.623530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:08.624228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:08.624686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:08.625163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:08.655568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1eaf1e24-63b1-437f-ab0b-62412c2bb38a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Aug 23 22:46:08.656132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 917/1863] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:09.667924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:09.670850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:09.677449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:09.677936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:09.678380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:09.679064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:09.679555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:09.679983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:09.710195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d25bc660-6922-496a-921d-edd4e57a6aa4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Aug 23 22:46:09.710759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 947/1864] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:10.722638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:10.724768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:10.731226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:10.731715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:10.732149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:10.732851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:10.733325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:10.733754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:10.747956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:10.766918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-889c5853-fac7-4c92-b3a5-c7d2e567da0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Aug 23 22:46:10.767499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 918/1865] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:11.778908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:11.780988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:11.787922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:11.788417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:11.788858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:11.789602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:11.790060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:11.790486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:11.820324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-853c76ba-43db-4394-a92b-3b4f9a2dcf8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Aug 23 22:46:11.820889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 948/1866] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:12.834269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:12.836383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:12.843702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:12.844190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:12.844662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:12.845338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:12.845788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:12.846212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:12.876271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b00b91e0-b630-48bd-ab6c-5abfee251fd7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Aug 23 22:46:12.876840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 919/1867] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:13.889305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:13.891435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:13.897880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:13.898367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:13.898804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:13.899500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:13.899949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:13.900370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:13.932449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8bd77f19-c844-4862-8e2c-73d4df30b386 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048002 Aug 23 22:46:13.933417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 949/1868] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:14.945501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:14.947682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:14.954077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:14.954558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:14.955025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:14.955721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:14.956177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:14.956603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:15.137406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aee421e0-8dfb-4c16-9f3e-71fbf7ac014b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195858 Aug 23 22:46:15.137870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 920/1869] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:16.149829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:16.151972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:16.158773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:16.159260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:16.159700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:16.160398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:16.160851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:16.161299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:16.191786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8b1e36c8-5663-429f-9d74-c0d6130c1a9b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Aug 23 22:46:16.192351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 950/1870] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:17.204064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:17.206243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:17.212424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:17.212907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:17.213377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:17.214066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:17.214521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:17.214967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:17.243916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-414927ee-b51f-4ed9-901e-c310c755b975 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 23 22:46:17.244458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 921/1871] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:18.257101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:18.259238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:18.266250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:18.266729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:18.267169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:18.267843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:18.268285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:18.268703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:18.296660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2852f663-290b-4151-90b3-c69cdb733079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 23 22:46:18.297244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 951/1872] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 22:46:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:19.316455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:46:19.318662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:19.325737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:19.326221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:19.326655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:19.327339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:19.327782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:19.328196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:19.436235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1152b4f9-7937-4431-b7c7-6049ee5b6318 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action" status: 200 len: 81864 microversion: 2.1 time: 0.124019 Aug 23 22:46:19.436894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 922/1873] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 22:46:19 2022] POST /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/action => generated 81864 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:46:19.449818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:19.450400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:19.452624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=42 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:19.457388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:19.457863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:19.458293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:19.459043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:19.459431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:19.459902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:19.590730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lazy-loading 'services' on Instance uuid 2cec364e-1e66-4f45-a083-ea4e54b53913 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:46:19.647424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Request method failure captured: Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments/4941c8d3-f0b7-414b-a921-ab428f21bfd8 HTTP/1.1 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVZoapngHQQFhsefeGm0Z5LqH7OZb0_FE0h3qzT4YzM5--B1oUAaNXvgv7L4m9pShm8Z3pDSd74S4Z80yvjF5CTflGpJCRLH5G4Hebk1L_yiZDZbcDvqNWQ7wGWnQWKb-fuUUNPAh1hApRSUy5Cl6XB1f-hQz52RKrCKSvlFrBQ9Luo Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 754172385f004ede86566e52cddf1d47 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-TestMinimumBasicScenario-1100080005 Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:46:19.649894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/754172385f004ede86566e52cddf1d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/754172385f004ede86566e52cddf1d47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/754172385f004ede86566e52cddf1d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_754172385f004ede86566e52cddf1d47", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-TestMinimumBasicScenario-1100080005 Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 754172385f004ede86566e52cddf1d47 Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1100080005 Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-TestMinimumBasicScenario-1100080005-project Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 692cc40ea1fe47a9904f1370a8d9ba2a Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-TestMinimumBasicScenario-1100080005-project Aug 23 22:46:19.651704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'server_id': '2cec364e-1e66-4f45-a083-ea4e54b53913', 'id': '4941c8d3-f0b7-414b-a921-ab428f21bfd8'} Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 23 22:46:19.652515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:46:19.653789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:19.655036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:46:19.656100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) Aug 23 22:46:19.657471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:46:19.658809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7ce1133-5458-451e-948a-4ce84766bd3f) {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:46:19.658809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bcf27a98-2b6a-4c9b-a85d-0a8f6e9d3dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments/4941c8d3-f0b7-414b-a921-ab428f21bfd8" status: 400 len: 269 microversion: 2.1 time: 0.205536 Aug 23 22:46:19.658809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 952/1874] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 22:46:19 2022] DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913/os-volume_attachments/4941c8d3-f0b7-414b-a921-ab428f21bfd8 => generated 269 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:46:36.987768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:36.988378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:36.991007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=39 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:36.991697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=25 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:36.996576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:36.997087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:36.997529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:36.998357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:36.998814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:36.999233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:37.024294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:46:37.394640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e0c7e7aa-229c-4487-b3e4-c86eeee7dfd6 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 204 len: 0 microversion: 2.1 time: 0.410744 Aug 23 22:46:37.395267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 923/1875] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:46:36 2022] DELETE /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:46:37.400973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:37.402459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=76 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:46:37.406372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:37.408393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:37.413494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:37.413985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:37.414423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:37.415140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:37.415594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:37.416030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:37.559913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:46:37.567864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-29599aaa-1304-4e95-b5aa-4f56995179fd tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1672 microversion: 2.1 time: 0.168284 Aug 23 22:46:37.568432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 953/1876] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:46:37 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:46:37.704254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:37.704828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:37.711939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:37.712415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:37.712846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:37.713572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:37.714776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:37.715203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:37.738905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3911dbe1-74f1-4dd7-9850-6d796b9f3e5a tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af/ips" status: 200 len: 152 microversion: 2.20 time: 0.039247 Aug 23 22:46:37.739486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 924/1877] 10.222.0.73 () {60 vars in 1289 bytes} [Tue Aug 23 22:46:37 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:46:38.590670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:38.591274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:38.598243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:38.598727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:38.599236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:38.600798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:38.601374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:38.601750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:38.738465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:46:38.747054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c044aacd-0fed-486e-8504-66d1f5c6025a tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1672 microversion: 2.1 time: 0.160650 Aug 23 22:46:38.747627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 954/1878] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:46:38 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:46:39.452888 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1a66ba-0f8a-44f0-8c11-b81be113a633", "name": "network-vif-deleted", "tag": "967a3daf-2e2c-41f1-80b5-4cf510ba8964"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:46:39.470636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:39.471364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:39.478285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:39.503056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] Creating event network-vif-deleted:967a3daf-2e2c-41f1-80b5-4cf510ba8964 for instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 on hv-cinder-84254 Aug 23 22:46:39.509453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-9ba4a673-d6ec-40ca-8eb0-3453664e43eb req-5c573c27-fd7b-48c7-bb81-b1d4f9da1e73 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062114 Aug 23 22:46:39.510047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 925/1879] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:46:39.768694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:39.769273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:39.775887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:39.777003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:39.777491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:39.778402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:39.778752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:39.779185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:39.846119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca578d6a1374212a4f1476335c641b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0430b3e5fcd0415fb2c658443d8f6bf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:46:39.855681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-948cdb63-4620-4bd8-8f95-95becfec78d8 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 200 len: 1322 microversion: 2.1 time: 0.090868 Aug 23 22:46:39.863670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 955/1880] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:46:39 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:46:40.876666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:40.877331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:46:40.884059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:40.884550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:40.884994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:40.885754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:46:40.886445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:46:40.886880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:46:40.902951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 HTTP/1.1 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:46:40.904609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:46:40.906252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '6d1a66ba-0f8a-44f0-8c11-b81be113a633'} Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:46:40.907157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:46:40.908665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:46:40.910072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:46:40.910072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-392f2556-a084-4a85-ac12-808e01ecbc1f tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 404 len: 111 microversion: 2.1 time: 0.033767 Aug 23 22:46:40.910072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 926/1881] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:46:40 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:46:40.915520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bae16433-c179-4805-85d6-95c0b2d31078 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '.version_select at 0x7f5ed57b04c0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:46:41.001216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bae16433-c179-4805-85d6-95c0b2d31078 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-857452113" status: 202 len: 0 microversion: 2.1 time: 0.089949 Aug 23 22:46:41.001804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 956/1882] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 22:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-857452113 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:47:55.361539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:47:55.362226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:47:57.054136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:47:57.054731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:47:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:48:35.067929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:48:35.068695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:49:32.683978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 22:49:32.687817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:32.688316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:32.690367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:49:32.691020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:49:32.695760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:32.696244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:32.696674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:32.697494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:32.697949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:32.699028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:32.727179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:49:32.907204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [33489337-a287-4a2c-80a1-d3f5c68bbb6e] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 22:49:33.213518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:49:33.214232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:49:33.691360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52790. Aug 23 22:49:33.914591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [33489337-a287-4a2c-80a1-d3f5c68bbb6e] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52796. Aug 23 22:49:33.993026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e60d7bf-d179-4398-ac36-34e58b7f8e34 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 204 len: 0 microversion: 2.1 time: 1.311610 Aug 23 22:49:33.993835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 927/1883] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:49:32 2022] DELETE /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 0 bytes in 1313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:49:34.000803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3842731b-e783-4419-8b17-ab775e165e14] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 22:49:34.001318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=18 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:49:34.002063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:49:34.007328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:34.007944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:34.014930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:34.015413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:34.015848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:34.016541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:34.016987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:34.017434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:34.156638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:34.165346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfae6f47-d6e6-4df6-8f36-8c5d6d7ba6bc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166779 Aug 23 22:49:34.165924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 957/1884] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:35.189143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:35.189837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:35.196890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:35.197390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:35.197821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:35.198694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:35.199200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:35.199620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:35.430660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:35.439657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-550abf99-b7f7-4c2d-a852-976d2eb1d91d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.254778 Aug 23 22:49:35.440227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 928/1885] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:35 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:36.462517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:36.463108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:36.471859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:36.472343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:36.472778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:36.473498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:36.473946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:36.474364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:36.491997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] [3842731b-e783-4419-8b17-ab775e165e14] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52828. Aug 23 22:49:36.607472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:36.615785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d968dbec-affb-4d5a-9c8e-c645334e80f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157106 Aug 23 22:49:36.616358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 958/1886] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:37.637708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:37.638297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:37.644747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:37.645263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:37.645691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:37.646380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:37.646826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:37.647242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:37.779377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:37.788208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4c68c5d0-f170-4cb9-97fe-9136786c65b1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155030 Aug 23 22:49:37.788767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 929/1887] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:37 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:38.809911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:38.810484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:38.816871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:38.817378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:38.817807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:38.818489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:38.818964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:38.819381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:38.950230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:38.958720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6849fed8-95b4-4383-8555-0494d3045296 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152720 Aug 23 22:49:38.959302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 959/1888] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:38 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:39.981342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:39.981946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:39.989512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:39.990003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:39.990438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:39.991145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:39.991595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:39.992015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:40.134870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:40.143317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-282d3810-792d-41b4-9160-adae751771a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166296 Aug 23 22:49:40.143921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 930/1889] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:41.165033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:41.165742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:41.172168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:41.172650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:41.173115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:41.173810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:41.174263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:41.174677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:41.306091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:41.314183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dae8ec8e-25d3-48fa-b816-ec37c5d81d9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152916 Aug 23 22:49:41.314748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 960/1890] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:42.335912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:42.336546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:42.343467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:42.343948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:42.344372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:42.345075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:42.345521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:42.345936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:42.478672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:42.487910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-df757264-acfb-4a18-b2d8-f518fd0c2147 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155792 Aug 23 22:49:42.488638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 931/1891] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:43.509486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:43.510096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:43.516665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:43.517182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:43.517608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:43.518302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:43.518744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:43.519159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:43.660241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:43.669040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-edba753d-d7c2-44cb-832a-fa2e5c119a72 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163496 Aug 23 22:49:43.669627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 961/1892] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:44.690795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:44.691418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:44.698567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:44.699053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:44.699493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:44.700185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:44.700639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:44.701088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:44.833862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:44.843076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4a0d3b5c-3372-41b1-9fd0-052c90a346f0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156016 Aug 23 22:49:44.843667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 932/1893] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:45.864561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:45.865143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:45.871839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:45.872326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:45.872760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:45.873483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:45.873935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:45.874360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:46.013748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:46.022284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6d65492c-8dbb-4adf-a1e0-5d6d5e354a9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161704 Aug 23 22:49:46.022846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 962/1894] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:45 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:47.044424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:47.045055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:47.051390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:47.051869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:47.052297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:47.052975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:47.053705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:47.054127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:47.186432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:47.194723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c74001c3-f8a7-459c-8fb3-279651c226de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154893 Aug 23 22:49:47.195282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 933/1895] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:48.215684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:48.216303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:48.222792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:48.223276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:48.223712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:48.224406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:48.224858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:48.225309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:48.359602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:48.367731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-81ba96f7-c840-4333-a4e7-b21c57c070cc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155887 Aug 23 22:49:48.368300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 963/1896] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:49.389812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:49.390431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:49.396784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:49.397314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:49.397754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:49.398446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:49.398906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:49.399330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:49.533407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:49.542466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-55092fec-45db-4df5-b339-ed558feb5580 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156274 Aug 23 22:49:49.543027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 934/1897] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:50.563930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:50.564539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:50.571015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:50.571499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:50.571957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:50.573214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:50.573648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:50.574064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:50.707086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:50.715670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ed83812f-31db-4098-8910-83dba8470cca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155633 Aug 23 22:49:50.716239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 964/1898] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:51.737359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:51.737977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:51.744970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:51.745496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:51.745935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:51.746636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:51.747100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:51.747527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:51.877002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:51.885378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-76711478-11d7-4d1f-ad4f-fecf97a4dafe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151904 Aug 23 22:49:51.885948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 935/1899] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:51 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:52.907732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:52.908330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:52.914910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:52.915394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:52.915898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:52.917649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:52.918113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:52.918544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:53.061446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:53.065215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-647129cc-9f3a-4a94-ad58-8d95af3e883c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161290 Aug 23 22:49:53.065785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 965/1900] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:54.087043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:54.088209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:54.096658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:54.097193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:54.097643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:54.098357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:54.098853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:54.099309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:54.237596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:54.246182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5afaf11b-7c2c-4e1f-a852-90b1e367f2c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163043 Aug 23 22:49:54.246762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 936/1901] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:55.267568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:55.268170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:55.274646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:55.275126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:55.275557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:55.276242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:55.276687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:55.277151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:55.408884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:55.418214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f9ea6cf-c47a-41d1-b3ed-053046f03d58 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154396 Aug 23 22:49:55.418802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 966/1902] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:56.440161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:56.440712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:56.448100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:56.448691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:56.449157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:56.449930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:56.450470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:56.450915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:56.584425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:56.592912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dc545035-5fa5-446a-868f-1c7bc81b911c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156866 Aug 23 22:49:56.593515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 937/1903] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:57.614688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:57.619431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:57.622924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:57.623432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:57.623924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:57.624633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:57.625115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:57.625547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:57.767968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:57.776843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eec121fc-454b-47f8-95b4-9c316a99f2fa tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165957 Aug 23 22:49:57.777465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 967/1904] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:58.798845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:58.799630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:58.806705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:58.807183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:58.807904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:58.808581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:58.808760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:58.809215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:58.948889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:49:58.958038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f239814e-3d1a-436c-99ff-0e8cb608ff92 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.162696 Aug 23 22:49:58.958936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 938/1905] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:58 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:49:59.983939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:49:59.984549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:49:59.991067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:59.991546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:59.991998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:49:59.992698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:49:59.993186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:49:59.993611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:00.132259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:00.141875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c7fc7433-5f13-465f-b8ef-9d8c5a1ed3b5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161752 Aug 23 22:50:00.142512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 968/1906] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:49:59 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:01.163245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:01.163856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:01.171477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:01.171971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:01.172410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:01.173145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:01.173603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:01.174032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:01.312849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:01.321268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b8715d30-f35e-4e59-8038-a18732055a7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161924 Aug 23 22:50:01.321847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 939/1907] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:02.342872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:02.343490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:02.349971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:02.350459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:02.350903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:02.351600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:02.352053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:02.352476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:02.491901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:02.501211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-22b9987a-c21e-447b-af1f-e69c20f7f264 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.162106 Aug 23 22:50:02.501789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 969/1908] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:03.523411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:03.523959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:03.526893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:03.532328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:03.532811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:03.533284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:03.533986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:03.534461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:03.534880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:03.537563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:03.679518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:03.691281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8c8c966f-c088-4d80-9a0a-fdf44156f5da tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.171574 Aug 23 22:50:03.692140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 940/1909] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:03 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:04.713859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:04.714528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:04.721000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:04.721529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:04.721960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:04.722680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:04.723124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:04.723538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:04.727930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=79 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:04.857493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:04.865718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2816314-6f8c-4899-9bba-9ec89b800b8c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156307 Aug 23 22:50:04.866284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 970/1910] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:05.887367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:05.887987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:05.894116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:05.894604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:05.895042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:05.895738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:05.896202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:05.896628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:06.030830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:06.038651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-745e0687-0394-44c6-b300-01b954c4394b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155472 Aug 23 22:50:06.039212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 941/1911] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:05 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:07.060518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:07.061114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:07.063002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=29 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:07.067954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:07.068445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:07.068885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:07.069623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:07.070118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:07.070538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:07.207788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:07.216892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2bdfaea8-dbd8-4f29-b3bd-7ea9144eb8ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160886 Aug 23 22:50:07.217538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 971/1912] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:08.240081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:08.240683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:08.247266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:08.247743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:08.248172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:08.248853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:08.249353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:08.249769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:08.381614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:08.390297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-be989c8a-734c-46c4-afa8-ee046033521a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154070 Aug 23 22:50:08.390850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 942/1913] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:50:09.411031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:09.411643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:09.419058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:09.419546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:09.419982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:09.420717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:09.421220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:09.421696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:09.568474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:09.578147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-13e6390c-615e-469b-abf4-89ce8ec0ab68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.170843 Aug 23 22:50:09.578710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 972/1914] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:10.601285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:10.601994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:10.608813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:10.609324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:10.609764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:10.610461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:10.610917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:10.611342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:10.745470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:10.754840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d24f3d13-7766-475d-9cea-2940682d4502 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157983 Aug 23 22:50:10.755481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 943/1915] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:10 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:11.778265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:11.778966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:11.786062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:11.786583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:11.787026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:11.787722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:11.788171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:11.788591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:11.918202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:11.927025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-61d41659-47f8-4ec3-ad04-db48eb84e9bf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153979 Aug 23 22:50:11.927948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 973/1916] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:11 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:12.949105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:12.949729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:12.956080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:12.956631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:12.957123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:12.957828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:12.958288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:12.958714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:13.179956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:13.188198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-181192d9-bbc1-4d2f-86bd-9ce4d6e30e36 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.243143 Aug 23 22:50:13.188765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 944/1917] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:12 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:14.213589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:14.214725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:14.221877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:14.222340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:14.222775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:14.223477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:14.223928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:14.224352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:14.360492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:14.370219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f5eb05c7-b714-45a1-83e8-2e898b3e7777 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163114 Aug 23 22:50:14.370822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 974/1918] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:15.392412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:15.393180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:15.400894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:15.401510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:15.402020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:15.402808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:15.403291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:15.403789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:15.539617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:15.548327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5982969a-e1d6-4bc7-83b4-7042f95531b7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160497 Aug 23 22:50:15.548879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 945/1919] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:16.570576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:16.571271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:16.578717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:16.579194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:16.579645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:16.580326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:16.580774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:16.581243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:16.719405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:16.727892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-627bf3a9-acec-4d83-b0a2-fe0a81850ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161450 Aug 23 22:50:16.741153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 975/1920] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:16 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:17.750205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:17.750815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:17.757207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:17.757683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:17.758110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:17.758788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:17.759231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:17.759645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:17.907302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:17.915713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-acd1c6cd-0f15-45c8-a973-b69167d0592e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.169435 Aug 23 22:50:17.916278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 946/1921] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:17 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:18.090623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:50:18.090873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:50:18.939637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:18.940441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:18.946860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:18.947390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:18.947818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:18.948500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:18.948944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:18.949385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:19.081300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:19.090411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f68a0d9-3134-492d-81b2-0ea90db35ba6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155354 Aug 23 22:50:19.091079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 976/1922] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:18 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:50:20.112600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:20.113299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:20.121147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:20.121640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:20.137752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:20.138838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:20.139434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:20.139863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:20.277680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:20.286918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8664bbab-fd18-4190-be0c-39230044d06f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.178454 Aug 23 22:50:20.287491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 947/1923] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:21.311901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:21.312719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:21.320961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:21.321631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:21.322261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:21.323286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:21.323906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:21.324348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:21.460930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:21.469947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5bb4acc-0132-4114-b4c8-a20b344d0a84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163303 Aug 23 22:50:21.470515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 977/1924] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:22.491760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:22.492368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:22.499418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:22.499899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:22.500330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:22.501031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:22.501482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:22.501898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:22.631576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:22.639989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-29603a10-e5db-422c-a0c2-fbcec3049c57 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152083 Aug 23 22:50:22.640568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 948/1925] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:22 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:23.662300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:23.662901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:23.669443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:23.669928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:23.670365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:23.671057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:23.671788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:23.672221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:23.815879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:23.823982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4bb2c878-b81c-4ff0-87e5-af5b16f43113 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165812 Aug 23 22:50:23.824544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 978/1926] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:23 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:24.846565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:24.847127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:24.853821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:24.854311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:24.854748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:24.855443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:24.855900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:24.856330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:24.989452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:24.997716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9acb1839-b03e-4019-921b-e0f54a3b168a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156282 Aug 23 22:50:24.998278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 949/1927] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:24 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:26.020529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:26.021284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:26.027642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:26.028126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:26.028567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:26.029287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:26.029744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:26.030170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:26.167721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:26.176981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ba7c76a8-23f1-4190-8421-4d01bf51ca0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160594 Aug 23 22:50:26.177868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 979/1928] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:50:27.197988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:27.200171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:27.206296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:27.206827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:27.207308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:27.208035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:27.208539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:27.208992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:27.349537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:27.358965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4b3c70f0-17ad-4ce1-888e-a0723d74db3a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.164670 Aug 23 22:50:27.359536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 950/1929] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:28.380239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:28.380858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:28.387213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:28.387702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:28.388142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:28.388843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:28.389327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:28.389768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:28.672206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:28.680473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fa982b7a-2d3d-4f36-a695-43a6d3e0f801 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.304075 Aug 23 22:50:28.681061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 980/1930] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:28 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:29.702496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:29.703120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:29.710324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:29.710811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:29.711251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:29.711942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:29.712397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:29.712821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:29.841036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:29.850043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1ba6e097-fa0c-4997-929f-674c663675ab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151514 Aug 23 22:50:29.850614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 951/1931] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:29 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:30.871669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:30.872201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:30.878626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:30.879103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:30.879541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:30.880220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:30.880666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:30.881107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:31.012936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:31.022497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-af66c121-8316-4467-8d31-bb2183d0c081 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154826 Aug 23 22:50:31.023051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 981/1932] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:30 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:32.043946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:32.044685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:32.052920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:32.053531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:32.053962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:32.054647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:32.055097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:32.055516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:32.193187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:32.201560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-166a90f1-71ed-4f99-b10a-246e0a9ee31a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161509 Aug 23 22:50:32.202057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 952/1933] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:33.223141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:33.223828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:33.230622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:33.231414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:33.232099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:33.233034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:33.233720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:33.234389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:33.364654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:33.372858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e6635ad-3530-4066-829d-f2f0592bd3ad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153721 Aug 23 22:50:33.373464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 982/1934] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:34.394694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:34.395294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:34.397284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=26 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:34.401944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:34.402419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:34.402843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:34.403550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:34.403994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:34.404410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:34.406903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:34.537720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:34.545982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-91e40c73-9d96-4e4c-9548-be4455df4789 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155425 Aug 23 22:50:34.546538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 953/1935] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:35.571775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:35.572422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:35.579089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:35.579568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:35.580005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:35.580696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:35.581195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:35.581620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:35.584185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:35.708387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:35.716403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5c6d6fd8-3a4f-47eb-ab52-3ab75edee35a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.148515 Aug 23 22:50:35.716955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 983/1936] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:35 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:36.740779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:36.741452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:36.748081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:36.748567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:36.748978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:36.749702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:36.750182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:36.750609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:36.889990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:36.899163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4c88a05b-d8fb-4a7c-b715-feefb465d2f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.164114 Aug 23 22:50:36.899759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 954/1937] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:37.920565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:37.921833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:37.924522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=26 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:50:37.929283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:37.929767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:37.930218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:37.930914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:37.931360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:37.931786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:38.068464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:38.076734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d75f4b48-e4fa-4938-8317-5775501bb259 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160180 Aug 23 22:50:38.077329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 984/1938] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:37 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:39.098428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:39.099033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:39.105430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:39.105911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:39.106339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:39.107051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:39.107510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:39.107921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:39.237667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:39.245879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2ecbb1af-e202-4233-b176-08e738b1f7ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151834 Aug 23 22:50:39.246451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 955/1939] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:40.267715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:40.268347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:40.274974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:40.275451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:40.275886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:40.276568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:40.277088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:40.277467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:40.414147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:40.422438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d792f8b8-1a64-44b3-9b8c-cf4a5fe34696 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158938 Aug 23 22:50:40.423000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 985/1940] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:40 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:41.444677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:41.445255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:41.451759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:41.452243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:41.452674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:41.453397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:41.453858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:41.454945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:41.584487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:41.592735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dc9f30bc-cbfd-4e8a-81b5-65f9559b8d32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152177 Aug 23 22:50:41.593337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 956/1941] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:42.615582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:42.616232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:42.622755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:42.623237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:42.623677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:42.624372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:42.624825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:42.625278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:42.763323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:42.772045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3620139a-96df-4541-9243-0e2af66dc63f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161306 Aug 23 22:50:42.772623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 986/1942] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:43.794239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:43.794842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:43.802181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:43.802657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:43.803089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:43.803767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:43.804214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:43.804874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:43.940492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:43.948976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c836388f-eff1-4e0a-a441-59ee698b7721 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158648 Aug 23 22:50:43.949563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 957/1943] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:44.972153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:44.972765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:44.979341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:44.979902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:44.980375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:44.981145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:44.981649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:44.982075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:45.119354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:45.127885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d38e4b1-c658-46a3-8d7c-064f6fc6c4fb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160517 Aug 23 22:50:45.128443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 987/1944] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:46.149343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:46.149953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:46.156309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:46.156784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:46.157819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:46.158574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:46.159034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:46.159453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:46.287790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:46.295899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a2c1d77d-e6ef-4899-8e66-45619e8f9f0a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150510 Aug 23 22:50:46.296485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 958/1945] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:47.318703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:47.319243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:47.325750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:47.326238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:47.326680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:47.327377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:47.327835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:47.328287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:47.460722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:47.470079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-39dad4a6-a323-43a9-b4c6-473bcb6cd390 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156274 Aug 23 22:50:47.471306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 988/1946] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:48.492495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:48.493155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:48.499682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:48.500173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:48.500609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:48.501467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:48.501926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:48.502461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:48.640263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:48.649313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e7b48787-1a83-43ea-87d5-9943debba7b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161471 Aug 23 22:50:48.649874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 959/1947] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:49.670965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:49.671582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:49.679038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:49.679525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:49.679965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:49.680662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:49.681151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:49.681582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:49.813532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:49.822214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9e05c131-5a3b-4e54-b483-b5d75b5e5d65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155095 Aug 23 22:50:49.822813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 989/1948] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:50.844629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:50.845253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:50.851747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:50.852238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:50.852679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:50.853404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:50.853890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:50.854315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:50.982772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:50.991678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-527c7277-6e89-42db-bf73-740072b14a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151300 Aug 23 22:50:50.992276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 960/1949] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:52.013923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:52.014548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:52.021887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:52.022516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:52.022958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:52.023689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:52.024145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:52.024571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:52.157291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:52.166015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ce19023-ed7b-41df-af54-a736c1903279 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156070 Aug 23 22:50:52.166585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 990/1950] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:53.188155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:53.188747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:53.195609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:53.196088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:53.196520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:53.197237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:53.197692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:53.198113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:53.329194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:53.338505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9c2781bd-d2c4-4825-8f2c-e4528f340e2d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154258 Aug 23 22:50:53.339068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 961/1951] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:53 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:50:54.360475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:54.361034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:54.367450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:54.367936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:54.368374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:54.369096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:54.369551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:54.369979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:54.507683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:54.515882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5018e702-826b-414d-965c-96978c2bd808 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159448 Aug 23 22:50:54.516443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 991/1952] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:55.537403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:55.538049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:55.545518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:55.546069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:55.546514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:55.547206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:55.547663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:55.548136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:55.681484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:55.690016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a37cce0d-f49b-49e2-b134-94fed49e3a59 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156495 Aug 23 22:50:55.690626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 962/1953] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:56.712786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:56.713470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:56.720031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:56.720533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:56.720973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:56.721696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:56.722146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:56.722565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:56.858100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:56.866460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4cb4e24a-7b45-4f19-8519-273f60960573 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158331 Aug 23 22:50:56.867051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 992/1954] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:57.888286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:57.888849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:57.895230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:57.895719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:57.896157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:57.896860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:57.897351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:57.897772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:58.029207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:58.038031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7a3ab7fe-be9b-4836-a2b0-d21a99e36604 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153714 Aug 23 22:50:58.038848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 963/1955] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:50:59.061678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:50:59.062142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:50:59.070242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:59.073035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:59.073471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:59.074178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:50:59.074623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:50:59.075039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:50:59.214923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:50:59.223221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-920b58a4-7eff-4c4c-832d-ec3233cff2f6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.168339 Aug 23 22:50:59.223781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 993/1956] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:50:59 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:00.243941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:00.244561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:00.251143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:00.251628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:00.252069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:00.252759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:00.253245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:00.253675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:00.386703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:00.395351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ea24754a-fd1d-42a4-9c4a-666a822a387b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155475 Aug 23 22:51:00.395928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 964/1957] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:01.419451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:01.420062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:01.426615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:01.427091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:01.427521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:01.428199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:01.428642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:01.429194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:01.564055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:01.572785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e8a8cef0-8912-4e3b-bb04-3a33966df7ed tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157137 Aug 23 22:51:01.576582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 994/1958] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:02.594755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:02.595339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:02.602806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:02.603299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:02.603739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:02.604434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:02.604889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:02.605350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:02.734182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:02.742335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a082df0a-60ca-416b-b81b-ed270b80af30 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151541 Aug 23 22:51:02.746338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 965/1959] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:03.767233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:03.767847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:03.774314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:03.774799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:03.775233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:03.775922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:03.776369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:03.776815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:03.907527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:03.917193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c4d4d55-4743-4b15-ba9a-ded60860ef7a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153750 Aug 23 22:51:03.917778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 995/1960] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:03 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:04.939202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:04.939843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:04.941763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=26 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:04.947080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:04.947554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:04.947987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:04.948717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:04.949278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:04.949701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:04.952214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:05.086546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:05.094622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7fd40663-3882-4655-8383-69892985647f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159448 Aug 23 22:51:05.095188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 966/1961] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:06.118811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:06.119429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:06.125851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:06.126333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:06.126774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:06.127464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:06.127920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:06.128371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:06.130928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:06.261201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:06.269394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a28279b7-7757-440a-bd6f-eec2d882f145 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154659 Aug 23 22:51:06.269971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 996/1962] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:06 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:07.293445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:07.294047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:07.301035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:07.301533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:07.301972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:07.302775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:07.303244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:07.303673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:07.434707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:07.443226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e1967c6b-2747-4ae8-a908-2e417f14f22f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155106 Aug 23 22:51:07.443846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 967/1963] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:08.466212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:08.466823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:08.468815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=26 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:08.473597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:08.474091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:08.474532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:08.475232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:08.475689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:08.476680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:08.606475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:08.614875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c0d00f3b-502e-4d4c-9cbf-e752f05dc156 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152726 Aug 23 22:51:08.615447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 997/1964] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:51:09.637764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:09.638380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:09.644891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:09.645400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:09.645836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:09.646660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:09.647077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:09.647377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:09.783149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:09.791931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-90953b5c-7f38-4ccc-938a-017649c30628 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158105 Aug 23 22:51:09.792481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 968/1965] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:10.814012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:10.814516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:10.821558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:10.822055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:10.822505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:10.823205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:10.823659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:10.824084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:10.955442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:10.964023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-65ff2b06-a5c5-4af2-a278-3942c77f954a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153898 Aug 23 22:51:10.964599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 998/1966] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:10 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:11.985368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:11.985987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:11.993043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:11.993540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:11.993980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:11.994787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:11.995245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:11.995668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:12.127190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:12.135852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-31d88e8e-2cd8-400a-8bee-60e9b3756469 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154499 Aug 23 22:51:12.136420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 969/1967] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:11 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:13.157890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:13.158420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:13.165395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:13.165879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:13.166311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:13.166989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:13.167435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:13.167851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:13.297959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:13.306330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ea950ddb-2ebc-4489-9875-244f60c2248e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152394 Aug 23 22:51:13.306891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 999/1968] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:13 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:14.328886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:14.329466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:14.335886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:14.336647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:14.337338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:14.338034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:14.338487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:14.338907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:14.471692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:14.480692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bf5d8c91-175e-485b-b832-7909992a5800 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155779 Aug 23 22:51:14.481301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 970/1969] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:15.372243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:51:15.373057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:51:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:51:15.504185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:15.504881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:15.513674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:15.514160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:15.514600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:15.515303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:15.515757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:15.516186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:15.648099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:15.656975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0612d8bf-5759-4a61-9624-366a29822b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157755 Aug 23 22:51:15.657602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1000/1970] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:16.680639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:16.681317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:16.691603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:16.691603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:16.691603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:16.691603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:16.692302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:16.692302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:16.829771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:16.838338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9fdb3770-4f2b-4a3f-92c8-dc837a9e4a18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161823 Aug 23 22:51:16.838899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 971/1971] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:16 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:17.063776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:51:17.064294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:51:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:51:17.859970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:17.860486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:17.866934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:17.867402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:17.867827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:17.868509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:17.868948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:17.869390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:18.012873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:18.017185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b310e09-9321-4f0d-927e-b2c3702e30a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161185 Aug 23 22:51:18.019204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1001/1972] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:17 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:19.040327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:19.040940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:19.047663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:19.048124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:19.048572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:19.049299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:19.050007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:19.050434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:19.180640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:19.189646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-05d4a805-d5c4-4895-aa00-17f6b1221bce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153364 Aug 23 22:51:19.190215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 972/1973] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:19 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:20.213250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:20.213876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:20.220504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:20.220992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:20.221467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:20.222162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:20.222617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:20.223042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:20.454455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:20.462742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fc5c668e-9fc8-40f7-a3ca-d8eaa8dc666c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.253448 Aug 23 22:51:20.463374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1002/1974] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:21.484881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:21.485672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:21.492412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:21.492902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:21.493441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:21.494142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:21.494602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:21.495030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:21.630512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:21.636603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7cfa83b4-3adb-4118-9669-8767cd508759 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156460 Aug 23 22:51:21.637349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 973/1975] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:22.658746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:22.659332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:22.665739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:22.666227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:22.666669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:22.667360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:22.667814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:22.668905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:22.802321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:22.810689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-504bd6ab-2251-41fb-b4c3-1024f91bb0c3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156016 Aug 23 22:51:22.811243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1003/1976] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:22 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:51:23.832176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:23.832786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:23.839255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:23.839741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:23.840350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:23.841070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:23.841531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:23.841955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:23.971764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:23.981199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7a39553-9f11-48dd-907f-21c0dc0ceaa9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152332 Aug 23 22:51:23.981834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 974/1977] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:23 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:25.002682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:25.003301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:25.010040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:25.010532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:25.010975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:25.011764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:25.012445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:25.012902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:25.144116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:25.154809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0dfad792-bef4-4ea2-aa07-ab4fd9c5a737 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156112 Aug 23 22:51:25.155389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1004/1978] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:24 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:26.178201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:26.178966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:26.186320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:26.186793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:26.187230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:26.187916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:26.188369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:26.188792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:26.319485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:26.327798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-913245db-bc48-433d-b2d7-de72ca80234f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153746 Aug 23 22:51:26.328361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 975/1979] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:27.349319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:27.349931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:27.356748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:27.357259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:27.357697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:27.358382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:27.358835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:27.359288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:27.503495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:27.513112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-23af6d19-7b42-452c-be78-a509e9b2fbaf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.167383 Aug 23 22:51:27.513940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1005/1980] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:28.534673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:28.535363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:28.541935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:28.542466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:28.543444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:28.544175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:28.544632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:28.545087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:28.679708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:28.689232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-db6da12f-5103-4c14-a065-7efff296af70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158490 Aug 23 22:51:28.689796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 976/1981] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:28 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:29.710965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:29.711576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:29.718402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:29.718884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:29.719319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:29.720007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:29.720457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:29.720879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:29.855913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:29.867542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b3741bb4-3ec8-4d89-aaf5-dc8706aefba7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160177 Aug 23 22:51:29.868325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1006/1982] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:29 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:30.889146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:30.889665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:30.896099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:30.896575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:30.897001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:30.897726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:30.898171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:30.898852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:31.032139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:31.040471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fc72a8d3-0d3a-4808-9097-8fc801ccf5be tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155312 Aug 23 22:51:31.041049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 977/1983] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:30 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:32.065346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:32.066272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:32.075654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:32.076349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:32.076924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:32.077915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:32.078513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:32.079075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:32.211998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:32.220213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bad2cf7c-d874-4032-88e0-41bb6e8a5ef1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160560 Aug 23 22:51:32.220775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1007/1984] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:33.242358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:33.242967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:33.249561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:33.250047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:33.250483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:33.251166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:33.251620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:33.252119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:33.386321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:33.395873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-689870de-b901-4cd0-b5b5-d7feee578602 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157333 Aug 23 22:51:33.396549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 978/1985] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:34.418188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:34.418825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:34.426160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:34.426635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:34.427063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:34.427784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:34.428228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:34.428644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:34.559560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:34.567627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78cac2af-385f-4439-b97c-786eb873223b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153438 Aug 23 22:51:34.568182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1008/1986] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:35.590170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:35.590758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:35.592581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=26 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:35.597262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:35.597741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:35.598171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:35.598845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:35.599290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:35.599708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:35.732682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:35.740846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-338e7f4e-9d4c-4658-89d2-9958d445219e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155410 Aug 23 22:51:35.741440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 979/1987] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:35 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:36.762989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:36.763622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:36.769844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:36.770349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:36.770764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:36.771446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:36.771894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:36.772321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:36.776259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:36.907595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:36.915878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8ced6f26-02a3-4300-97c1-e4ab3759326e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156839 Aug 23 22:51:36.916444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1009/1988] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:37.938078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:37.938694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:37.945317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:37.945803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:37.946270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:37.946962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:37.947443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:37.947868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:37.951461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=84 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:38.083410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:38.091944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-94a4d936-e22b-4caa-a4c6-37c7db3a222d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157803 Aug 23 22:51:38.092518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 980/1989] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:37 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:39.113942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:39.114636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:39.116957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=26 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:51:39.121826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:39.122304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:39.122741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:39.123421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:39.123865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:39.124282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:39.253825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:39.262466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c75d11ff-4221-4855-9673-646826fbe729 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152522 Aug 23 22:51:39.263022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1010/1990] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:40.283979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:40.284633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:40.291055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:40.291526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:40.291953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:40.293303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:40.293839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:40.294257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:40.425575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:40.434461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-689c55f5-ec44-4a5d-ba75-92746032bcd6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154406 Aug 23 22:51:40.435055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 981/1991] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:40 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:41.455876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:41.456524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:41.463310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:41.463901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:41.464343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:41.465064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:41.465523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:41.466032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:41.600205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:41.608993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe308ccc-9598-43f1-b4a9-b3e7cf80f9ba tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157117 Aug 23 22:51:41.609585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1011/1992] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:42.630861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:42.631485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:42.638018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:42.638506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:42.639430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:42.640125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:42.640580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:42.641027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:42.772302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:42.782631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-849adbd3-93dd-4c2a-8c99-214ed5c60f01 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155648 Aug 23 22:51:42.783238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 982/1993] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:43.804333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:43.804915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:43.812127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:43.812610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:43.813082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:43.813774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:43.814224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:43.814646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:43.946108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:43.954787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2a77ada-623e-45d9-b328-b49de3d4b212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154368 Aug 23 22:51:43.955358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1012/1994] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:44.977005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:44.977655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:44.984817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:44.985320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:44.985752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:44.986464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:44.986911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:44.987358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:45.135073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:45.143729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-09015d26-af72-4fc1-bd5a-f44248ce7798 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.170585 Aug 23 22:51:45.144230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 983/1995] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:46.165257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:46.165794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:46.172474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:46.172956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:46.173672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:46.174356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:46.174804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:46.175224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:46.308826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:46.317985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d8f1f3ab-de16-45a8-8cde-5bbd3c3cb0e7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156781 Aug 23 22:51:46.318550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1013/1996] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:47.340412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:47.341061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:47.347681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:47.348163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:47.348603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:47.349342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:47.349795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:47.350226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:47.488489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:47.496771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b07db86a-d1fa-4c9f-bed3-5e17db30cbf7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160393 Aug 23 22:51:47.497367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 984/1997] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:48.519837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:48.520508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:48.527047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:48.527566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:48.528001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:48.528698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:48.529217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:48.529826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:48.658049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:48.667409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7b0d8e76-cb7c-405e-ad0a-c03ed01a04ec tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151726 Aug 23 22:51:48.667974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1014/1998] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:49.694014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:49.694620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:49.701642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:49.702468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:49.703234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:49.704463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:49.705360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:49.706194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:49.838045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:49.847368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fc773821-85b5-4976-abe0-8bd76583bd1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156911 Aug 23 22:51:49.847717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 985/1999] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:50.869465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:50.870022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:50.877094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:50.877578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:50.878015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:50.878753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:50.879202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:50.879662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:51.022046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:51.030789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7403ddbc-2295-498d-9732-be4740f863c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165384 Aug 23 22:51:51.031360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1015/2000] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:52.053096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:52.053713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:52.060248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:52.060738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:52.061209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:52.061900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:52.062350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:52.062774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:52.196304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:52.204599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e48113c6-ac1c-4dc0-b505-d329e40df684 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155546 Aug 23 22:51:52.205185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 986/2001] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:53.226583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:53.227199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:53.233914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:53.234405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:53.234844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:53.235532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:53.235987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:53.236412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:53.363653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:53.371838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a1601de6-00aa-43b8-83ec-75fdb69a5e37 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.148981 Aug 23 22:51:53.372417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1016/2002] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:53 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:54.393593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:54.394161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:54.400510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:54.400982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:54.401438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:54.402143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:54.402609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:54.403005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:54.531944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:54.540143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1144b376-6e4e-49fc-9698-285248084adc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150523 Aug 23 22:51:54.540701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 987/2003] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:55.076623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:51:55.077177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:51:55.563159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:55.563790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:55.570433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:55.570906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:55.571334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:55.572061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:55.572508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:55.572925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:55.704426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:55.712688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-82009b1e-b2d6-41b2-8011-ef0e4bde9823 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153981 Aug 23 22:51:55.713285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1017/2004] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:56.735009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:56.735618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:56.741926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:56.742404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:56.742836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:56.743524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:56.743972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:56.744388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:56.891264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:56.899839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8b69cad9-dcc1-48a2-8a2e-f30096dfff68 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.169192 Aug 23 22:51:56.900409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 988/2005] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:51:57.923028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:57.923666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:57.930191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:57.930616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:57.931056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:57.931774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:57.932229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:57.932677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:58.072546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:58.080883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4aa907fe-566d-48d2-8450-64316b0f399f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161891 Aug 23 22:51:58.081466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1018/2006] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:51:59.102511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:51:59.103172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:51:59.109834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:59.110323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:59.110769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:59.111474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:51:59.111926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:51:59.112387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:51:59.243692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:51:59.252603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-150c836e-1bc8-42e7-b1d7-43f2fb53d61b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154028 Aug 23 22:51:59.253201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 989/2007] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:51:59 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:00.274799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:00.275431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:00.282690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:00.283259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:00.283689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:00.284393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:00.284878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:00.285318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:00.413185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:00.421399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4986d486-1fe9-4e6a-bc2c-6c8140b775dc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150527 Aug 23 22:52:00.421962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1019/2008] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:01.442636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:01.443222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:01.449666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:01.450152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:01.450588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:01.451279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:01.451733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:01.452159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:01.589539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:01.598133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-85ff56d2-b7c0-40ff-b967-173f80e63cab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159517 Aug 23 22:52:01.598684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 990/2009] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:02.619858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:02.620446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:02.627633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:02.628146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:02.628534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:02.629251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:02.629705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:02.630132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:02.766655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:02.776520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-99d45f9e-a28c-4597-80fd-0c674e4dae50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160429 Aug 23 22:52:02.777683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1020/2010] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:02.835632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:02.836710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:02.845067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:02.845858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:02.846495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:02.847235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:02.847727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:02.848214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:02.877128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:52:03.220309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b76c5463-d59f-48b7-b954-b11bc6638bf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 204 len: 0 microversion: 2.1 time: 0.387796 Aug 23 22:52:03.220941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 991/2011] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:52:02 2022] DELETE /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:52:03.229366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:03.230001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:03.237461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:03.238429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:03.240982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:03.240982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:03.240982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:03.240982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:03.371189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:03.379893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf856214-38b3-4d85-948d-22e6674d1859 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.154451 Aug 23 22:52:03.380456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1021/2012] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:03.807953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:03.808822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:03.823746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:03.823746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:03.823746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:03.823746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:03.824233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:03.824233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:03.955722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:03.963886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1faf9388-d1ed-49fd-b8eb-7d91cc920c56 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160443 Aug 23 22:52:03.964451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 992/2013] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:03 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:04.401801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:04.402345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:04.409586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:04.410110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:04.410557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:04.411247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:04.411703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:04.412123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:04.544872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:04.554474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97fe0845-fd98-44b6-ba22-8f50d3ecdcd0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1735 microversion: 2.1 time: 0.156543 Aug 23 22:52:04.555344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1022/2014] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:04.986363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:04.987003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:04.994081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:04.994689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:04.995127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:04.995832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:04.996294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:04.996712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:05.151443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:05.161093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-744c46bc-9d9d-4b3b-9d8d-8059cc2bb276 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.177454 Aug 23 22:52:05.161093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 993/2015] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:05.576126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:05.577585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:05.585313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:05.586099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:05.586790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:05.587101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bede37e-5924-4bc2-9b2f-2a29c6e24b73", "name": "network-vif-deleted", "tag": "2d80ac4e-bff8-4646-a76e-947d299748d7"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:52:05.588202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:05.588822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:05.589495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:05.615719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:05.616613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:05.617297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:05.631820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] Creating event network-vif-deleted:2d80ac4e-bff8-4646-a76e-947d299748d7 for instance 6bede37e-5924-4bc2-9b2f-2a29c6e24b73 on hv-cinder-84254 Aug 23 22:52:05.638590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-7f662e84-3193-42d5-ae44-c508ae336561 req-50753dbb-448d-4a8a-a339-666053427034 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139219 Aug 23 22:52:05.639527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1023/2016] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:52:05.676486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:05.680877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-43cfd9ac-dcb0-4f94-a044-b4d26af93777 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1668 microversion: 2.1 time: 0.108770 Aug 23 22:52:05.685370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 994/2017] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1668 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:06.182185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:06.182979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:06.190126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:06.190728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:06.191226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:06.191992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:06.192510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:06.193026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:06.326628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:06.335845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1211370-8e34-473e-93a0-5536f41b5e00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157892 Aug 23 22:52:06.336431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1024/2018] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:06 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:06.702895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:06.703543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:06.707547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:06.710921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:06.711408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:06.711891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:06.712568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:06.713030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:06.713462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:06.717388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:06.782694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:06.791030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7cd3e506-8d4d-4c3a-b0b3-7ea72409a197 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092179 Aug 23 22:52:06.791595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 995/2019] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:07.357974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:07.358599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:07.366031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:07.366515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:07.366953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:07.367643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:07.368091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:07.368520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:07.371229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=92 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:07.508953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:07.518612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07efca0d-f923-4a1d-8f13-88b285757f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.164626 Aug 23 22:52:07.519188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1025/2020] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:07.812902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:07.814323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:07.821206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:07.821685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:07.822113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:07.822800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:07.823248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:07.823666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:08.128384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:08.136686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-483619bc-51f3-48ea-8a85-b1dafbcc7e10 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.328420 Aug 23 22:52:08.137268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 996/2021] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:08.540928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:08.541576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:08.548338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:08.548812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:08.549279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:08.550379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:08.550774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:08.551201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:08.687585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:08.695982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c46fa1e1-ec3a-4923-ba0d-60e8ef5a9e76 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159200 Aug 23 22:52:08.696549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1026/2022] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:09.157043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:09.158014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:09.164523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:09.165004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:09.165497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:09.166189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:09.166648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:09.167080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:09.231986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:09.241041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-40e07058-b0bb-4846-b22b-8bbf1de9b4b3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088015 Aug 23 22:52:09.241618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 997/2023] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:09.718356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:09.718968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:09.722047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=34 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:09.726768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:09.733769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:09.733769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:09.733769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:09.733769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:09.734271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:09.858981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:09.867878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b3dde03-96b6-427c-9301-2090409cdefd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153461 Aug 23 22:52:09.868448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1027/2024] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:10.263066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:10.263708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:10.271215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:10.271706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:10.272145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:10.272874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:10.273456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:10.273905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:10.336098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:10.344223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ba8b49b3-2ca1-4785-95c1-162056cbf015 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085424 Aug 23 22:52:10.344776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 998/2025] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:10.889417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:10.889998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:10.896675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:10.897219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:10.897698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:10.898390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:10.898841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:10.899277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:11.032256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:11.040622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bb9ecbf1-9e34-46d4-87c7-f1cf25f9bd6f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155225 Aug 23 22:52:11.041211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1028/2026] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:10 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:11.365708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:11.366308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:11.372822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:11.373348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:11.373805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:11.374505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:11.374972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:11.375394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:11.437614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:11.446041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-06abb381-f9ea-4ce0-84d5-68a442cc58ad tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085034 Aug 23 22:52:11.446635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 999/2027] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:12.063100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:12.063721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:12.070820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:12.071300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:12.071739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:12.072456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:12.072907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:12.073365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:12.206047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:12.214426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a9460709-e2e1-4f79-a903-231c145b335f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155221 Aug 23 22:52:12.214989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1029/2028] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:12 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:12.467403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:12.468008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:12.475031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:12.475510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:12.475938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:12.476622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:12.477096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:12.477516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:12.541841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:12.550991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a5425241-f4f2-408f-8856-ef18d0b69a33 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087559 Aug 23 22:52:12.551559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1000/2029] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:13.236113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:13.236711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:13.243527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:13.244009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:13.244475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:13.245215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:13.245670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:13.246093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:13.378894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:13.387786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e68562b-3302-4ed1-a4fc-f1fda3949350 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155752 Aug 23 22:52:13.388389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1030/2030] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:13 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:13.572456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:13.573100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:13.579547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:13.580036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:13.580474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:13.582788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:13.582788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:13.583011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:13.644457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:13.652742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2d121cdd-26f6-4d05-9f55-805917b8967a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084270 Aug 23 22:52:13.653364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1001/2031] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:14.410659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:14.411245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:14.417675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:14.418156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:14.418592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:14.419280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:14.419739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:14.420166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:14.548914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:14.557839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c7fe8748-a35c-4cdd-a14b-c121b0da7f31 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151680 Aug 23 22:52:14.558236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1031/2032] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:14.673557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:14.674111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:14.680770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:14.681628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:14.682068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:14.682755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:14.683216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:14.683692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:14.748803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:14.758046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b2ad412-1c92-4744-9502-b5ee03ada027 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088718 Aug 23 22:52:14.758611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1002/2033] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:15.578698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:15.579808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:15.586619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:15.587116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:15.587558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:15.588308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:15.588764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:15.589227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:15.723670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:15.733498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-32c381b9-c8a4-4928-a3a4-10bdbdf1ec3d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158319 Aug 23 22:52:15.734065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1032/2034] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:15.779893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:15.780612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:15.788112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:15.788533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:15.788972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:15.789703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:15.790171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:15.790593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:15.867874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:15.876011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-106e132f-1c44-42a6-b74d-8a3dfb58fc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.100085 Aug 23 22:52:15.876581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1003/2035] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:16.755814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:16.756420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:16.763308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:16.763853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:16.764334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:16.765083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:16.765575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:16.766053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:16.897446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:16.898501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:16.907510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:16.908178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:16.908328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:16.908953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:16.909913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:16.910423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:16.910881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:16.916651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19fc23e6-84e5-4c58-82bf-23c7831ecde4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165333 Aug 23 22:52:16.917262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1033/2036] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:16 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:16.976274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:16.986675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b8ad1120-4891-4aaa-8897-3e87f7149940 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094230 Aug 23 22:52:16.988034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1004/2037] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:17.938846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:17.939391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:17.946116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:17.946596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:17.947084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:17.947814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:17.948266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:17.948687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:18.008391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:18.009029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:18.015941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:18.016438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:18.016882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:18.017623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:18.018258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:18.018843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:18.085250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:18.086222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:18.093948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cac1c52c-fd77-49a1-89ba-cd62966abcb7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089826 Aug 23 22:52:18.094539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1005/2038] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:18.095048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8b938207-3581-4d96-99ac-17ebe691b6ae tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160227 Aug 23 22:52:18.095632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1034/2039] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:17 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:19.117005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:19.117726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:19.118203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:19.118776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:19.123880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:19.124358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:19.128604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:19.128783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:19.128905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:19.129024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:19.129194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:19.129303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:19.129437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:19.129539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:19.129539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:19.129539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:19.190582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:19.199822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-08381562-3b8d-4c86-832b-0d67e0702450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086665 Aug 23 22:52:19.200390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1006/2040] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:19.263123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:19.271978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cbd5f26b-77c2-4b97-8627-d95030b11c63 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157686 Aug 23 22:52:19.272539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1035/2041] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:19 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:20.221706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:20.222375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:20.228612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:20.229105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:20.229534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:20.230216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:20.230659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:20.231090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:20.293391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:20.294007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:20.298575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:20.301146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:20.301638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:20.302075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:20.302775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:20.303228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:20.303650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:20.307342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-33642fc1-373e-4b42-8cfb-a8afd989722a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090220 Aug 23 22:52:20.307916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1007/2042] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:20.430855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:20.438905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf3bbee3-13e3-44b2-8524-aefa3e635a73 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.149467 Aug 23 22:52:20.439469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1036/2043] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:21.329456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:21.330106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:21.339575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:21.340070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:21.340505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:21.341237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:21.341695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:21.342120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:21.403824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:21.412100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ac9cfa6-719e-4bf4-bbfe-6c8f07abd006 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086569 Aug 23 22:52:21.412658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1008/2044] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:21.459987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:21.460572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:21.467197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:21.467704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:21.468135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:21.468818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:21.469286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:21.469700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:21.608251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:21.617273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-45edebe0-d1b4-47df-b221-bb1ca28e0f38 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161383 Aug 23 22:52:21.617835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1037/2045] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:22.433656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:22.434254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:22.445220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:22.445708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:22.446136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:22.446822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:22.447266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:22.447680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:22.509822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:22.517878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5b4da95f-78ee-459a-9403-0c18b2a420b8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088080 Aug 23 22:52:22.518519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1009/2046] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:22.639033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:22.639639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:22.646432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:22.646907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:22.647344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:22.648032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:22.648486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:22.648912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:22.778631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:22.787575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f2610cf8-1bd5-4a66-bb4e-7ec49ad37421 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152417 Aug 23 22:52:22.788149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1038/2047] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:22 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:23.538944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:23.539535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:23.545859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:23.546343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:23.547041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:23.547725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:23.548177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:23.548599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:23.613355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:23.621558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f6fc3753-9a8a-4877-9329-94ba3505b669 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087013 Aug 23 22:52:23.622127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1010/2048] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:23.810107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:23.810658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:23.817881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:23.818415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:23.818876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:23.819568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:23.820031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:23.820455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:23.954235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:23.963318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cb8fc30c-8aae-4671-8509-0d6fd5fd1ed7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157213 Aug 23 22:52:23.963882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1039/2049] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:23 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:24.642837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:24.643465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:24.649926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:24.650421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:24.650856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:24.651548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:24.652003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:24.652429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:24.716858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:24.719053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:24.726265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b7b64265-5c08-466b-a920-9c833fb18c56 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087355 Aug 23 22:52:24.726837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1011/2050] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:24.985058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:24.986043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:24.992250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:24.992738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:24.996652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:24.996652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:24.996652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:24.996652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:25.128946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:25.137346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b331ea60-9e8b-4113-9c22-1f238ee4c2f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156295 Aug 23 22:52:25.137914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1040/2051] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:24 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:25.752931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:25.753759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:25.760809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:25.761324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:25.761771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:25.762474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:25.762918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:25.763344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:25.825456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:25.834296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3b2f1e40-0013-41a1-9ab5-3db2e42f502f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085552 Aug 23 22:52:25.834859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1012/2052] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:26.159989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:26.160566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:26.167125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:26.167603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:26.168035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:26.168717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:26.169277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:26.169700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:26.298429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:26.301272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:26.308060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-365be6d0-3a03-4d30-abe0-702f47538c1b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152517 Aug 23 22:52:26.308639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1041/2053] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:26.855843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:26.856412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:26.863142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:26.863621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:26.864058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:26.864749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:26.865235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:26.865658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:26.926931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:26.935304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e096aa1e-c66d-4c0b-9dcc-7db026c7f784 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083444 Aug 23 22:52:26.935875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1013/2054] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:27.343081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:27.343752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:27.351198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:27.351715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:27.352176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:27.352874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:27.353353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:27.353782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:27.484944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:27.494136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b1642a07-30d8-43a0-b3c3-6c1edcb10793 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158800 Aug 23 22:52:27.494735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1042/2055] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:27.956415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:27.957452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:27.963652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:27.964132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:27.964627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:27.965332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:27.965781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:27.966219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:28.028905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:28.037907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b3b8c05d-db86-48c8-bdb1-08e2f110c8d5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086031 Aug 23 22:52:28.038477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1014/2056] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:28.516979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:28.517722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:28.525992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:28.526576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:28.527144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:28.527956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:28.528542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:28.529046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:28.669728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:28.678627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c1c325e1-9f74-4950-ac02-231efb2c33ca tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166772 Aug 23 22:52:28.679187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1043/2057] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:28 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:29.059602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:29.060359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:29.067336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:29.067832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:29.068270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:29.068982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:29.069465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:29.069892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:29.134751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:29.144312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-745becfd-cbdf-40ab-b453-6b8f91eb5734 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088801 Aug 23 22:52:29.144879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1015/2058] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:29.700670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:29.701287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:29.708472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:29.708954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:29.709417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:29.710105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:29.710561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:29.710983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:29.839783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:29.848329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d5899ae7-aec9-4d51-a559-a3dd32c956cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151553 Aug 23 22:52:29.848898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1044/2059] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:29 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:30.164945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:30.165733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:30.172550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:30.173052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:30.173497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:30.174413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:30.175451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:30.175924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:30.239552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:30.247797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d0b9eaaf-3057-43b6-bb9e-33f98e10c3d0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086794 Aug 23 22:52:30.248361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1016/2060] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:30.870009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:30.870620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:30.877023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:30.877587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:30.878731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:30.879584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:30.880037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:30.880481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:31.014806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:31.024852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d0410344-9d09-446c-900e-0c8dd1d2978a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158818 Aug 23 22:52:31.025450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1045/2061] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:30 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:31.269578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:31.270215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:31.276934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:31.277459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:31.277971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:31.278707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:31.279166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:31.279632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:31.343869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:31.353220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3c315a67-0a2b-459d-aa6d-0e105e193b0c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087849 Aug 23 22:52:31.353788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1017/2062] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:32.046699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:32.047307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:32.054061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:32.056354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:32.056354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:32.056354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:32.056354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:32.056755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:32.186497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:32.195439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e774dc25-46a1-4f09-846c-abb692160a6e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152915 Aug 23 22:52:32.196008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1046/2063] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:32.374898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:32.375526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:32.382747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:32.383241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:32.383678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:32.384373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:32.384831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:32.385295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:32.448419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:32.456932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-518dfd5e-df8f-42b0-9c29-edd70d2d6b8b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086088 Aug 23 22:52:32.457523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1018/2064] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:33.217602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:33.218206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:33.225244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:33.225720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:33.226147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:33.226850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:33.227330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:33.227742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:33.359113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:33.367197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6519581d-eb4d-4524-9ef2-e5804891acd4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153521 Aug 23 22:52:33.367764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1047/2065] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:33.477651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:33.478196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:33.484559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:33.485065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:33.485497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:33.486191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:33.486641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:33.487064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:33.551904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:33.560418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6a925bf-58f5-40e3-9f00-1551d9c600dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086761 Aug 23 22:52:33.560984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1019/2066] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:34.388720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:34.389340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:34.396212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:34.396687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:34.397144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:34.397818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:34.398259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:34.398719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:34.528291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:34.537461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3d8f7ce5-6f22-4c2c-83c9-ec9b5b3eaf70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152595 Aug 23 22:52:34.538043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1048/2067] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:34.582398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:34.583003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:34.588974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:34.589513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:34.589942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:34.590812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:34.591350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:34.591773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:34.654359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:34.662560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a41e105b-77c9-4e46-9b49-375a195e659a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084763 Aug 23 22:52:34.663129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1020/2068] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:35.559847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:35.560464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:35.567697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:35.568174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:35.568617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:35.569363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:35.569818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:35.570242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:35.684778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:35.685559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:35.693448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:35.693946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:35.694385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:35.695092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:35.695540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:35.695967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:35.711711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:35.719871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-16951ce2-ea19-431b-8b8a-1da9258f9ec8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163914 Aug 23 22:52:35.720437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1049/2069] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:35 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:35.759484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:35.767790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6b32bcbc-74df-4d5c-ad45-37d3cba14bd8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087918 Aug 23 22:52:35.768369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1021/2070] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:36.742318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:36.743102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:36.749351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:36.749840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:36.750280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:36.750964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:36.751496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:36.751922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:36.791335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:36.791984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:36.799159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:36.799680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:36.800092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:36.800798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:36.801838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:36.802345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:36.874034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:36.883750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-06f12ab2-b5ec-465e-8a75-6868b43a1aa0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.096456 Aug 23 22:52:36.884450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1022/2071] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:37.119876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:37.128123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2f64476a-792a-42c7-aba8-8a7681feab80 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.390616 Aug 23 22:52:37.128631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1050/2072] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:37.905691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:37.906226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:37.908545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=56 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:37.915240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:37.915755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:37.916197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:37.916974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:37.917456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:37.917958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:37.989132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:37.998328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-73fb1b3c-7999-4ac9-85a7-d3a9cd0e2bb2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.096678 Aug 23 22:52:37.998895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1023/2073] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:38.149984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:38.150584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:38.157082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:38.157498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:38.157924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:38.158595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:38.159037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:38.159449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:38.290738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:38.299249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ce1f57d9-e48b-4566-aa35-c0a7fb82bd28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153291 Aug 23 22:52:38.299815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1051/2074] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:38 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:39.019618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:39.020234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:39.026683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:39.027361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:39.027810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:39.028511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:39.028966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:39.029500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:39.091275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:39.099588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-208e87de-6565-48a4-9241-a4353b3b4e9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083844 Aug 23 22:52:39.100162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1024/2075] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:39.321490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:39.322051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:39.328309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:39.328772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:39.329236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:39.329909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:39.330351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:39.330765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:39.465572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:39.473614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-736d10b3-09ea-487a-ad97-f90ac0a38daf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156788 Aug 23 22:52:39.474711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1052/2076] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:40.121627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:40.122247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:40.128639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:40.129157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:40.129594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:40.130824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:40.131285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:40.131705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:40.193552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:40.203923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-904ad477-8f66-4567-b70a-88ba06283386 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086148 Aug 23 22:52:40.204497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1025/2077] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:40.497128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:40.497789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:40.500695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=52 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:40.506545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:40.507170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:40.507908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:40.508867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:40.509406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:40.509953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:40.646723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:40.654963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e018449f-8a86-4f01-ae0d-c3dc1dd9104e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.162170 Aug 23 22:52:40.655532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1053/2078] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:40 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:41.227930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:41.228540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:41.235052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:41.235537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:41.235977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:41.236666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:41.237274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:41.237704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:41.301887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:41.310584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eab74e1a-26fd-40bc-a366-996e317b0a64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087126 Aug 23 22:52:41.311149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1026/2079] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:41.676305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:41.677605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:41.684004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:41.684474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:41.684903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:41.685606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:41.686054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:41.686467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:41.818688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:41.827309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b68d081c-262b-44a6-9757-2144e9a6fb50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154861 Aug 23 22:52:41.827909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1054/2080] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:42.331375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:42.331992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:42.339343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:42.339832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:42.340273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:42.340976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:42.341462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:42.341886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:42.407178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:42.415531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5c30507c-df96-4406-b9fc-3ac96954086d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088034 Aug 23 22:52:42.416107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1027/2081] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:42.849808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:42.850457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:42.857144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:42.857651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:42.858087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:42.858821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:42.859294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:42.859745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:43.011128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:43.019184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a4ef423c-6da5-4aea-b489-cd413668bd5c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.173508 Aug 23 22:52:43.019749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1055/2082] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:43.436682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:43.437520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:43.444250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:43.444735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:43.445211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:43.445903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:43.446356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:43.446777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:43.461673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:43.509279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:43.517885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ba8c014b-ea26-4a8c-8774-e78ad2dc5f52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085030 Aug 23 22:52:43.518481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1028/2083] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:44.041612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:44.042235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:44.049118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:44.049649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:44.050087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:44.050897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:44.051396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:44.052386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:44.183261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:44.191726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-98b11d69-9de9-46bb-93bf-a53393e8355f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154019 Aug 23 22:52:44.192387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1056/2084] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:44.540071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:44.540982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:44.547680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:44.548171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:44.548647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:44.549358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:44.549800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:44.550225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:44.618434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:44.626554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6462ec2d-33b0-4f69-9293-bfb730ca9d83 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091307 Aug 23 22:52:44.627113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1029/2085] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:45.213219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:45.213813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:45.220334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:45.220888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:45.221360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:45.222040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:45.222490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:45.222910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:45.357500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:45.366630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c056bde2-bb4e-4830-8177-c6aa92b20ad6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157558 Aug 23 22:52:45.367204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1057/2086] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:45 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:45.648024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:45.648625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:45.655157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:45.655632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:45.656063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:45.656738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:45.657286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:45.657700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:45.718813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:45.727767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8376637c-1537-4f80-9928-b9aaad2af195 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083813 Aug 23 22:52:45.728327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1030/2087] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:46.388155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:46.388727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:46.396161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:46.396648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:46.397108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:46.397796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:46.398280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:46.398702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:46.413233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:52:46.528280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:46.536518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-da62519e-f485-4064-9f4a-39a436bc850b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152346 Aug 23 22:52:46.537102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1058/2088] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:46.749795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:46.750392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:46.757919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:46.758400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:46.758836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:46.759561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:46.760015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:46.760440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:46.827045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:46.836162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a35cfe0d-9673-4c38-88bf-c6f28cdcb379 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090211 Aug 23 22:52:46.836778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1031/2089] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:47.558441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:47.559083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:47.565795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:47.566276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:47.566713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:47.567399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:47.567936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:47.568361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:47.701155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:47.710347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cd0397e0-9270-4464-9721-b3f89d2678d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155836 Aug 23 22:52:47.710981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1059/2090] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:47.858555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:47.859114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:47.865731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:47.866220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:47.866657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:47.867420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:47.867879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:47.868307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:47.930906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:47.939213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92b72d6d-ced7-486a-93ae-f1b8e2053e73 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084747 Aug 23 22:52:47.939764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1032/2091] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:48.732309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:48.732955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:48.739831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:48.740308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:48.740747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:48.741467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:48.741917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:48.742337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:48.878860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:48.887493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-94a5d066-696d-4b72-b672-e1d09c876435 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159074 Aug 23 22:52:48.888073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1060/2092] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:48.960453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:48.961083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:48.967656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:48.968137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:48.968573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:48.969291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:48.969747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:48.970271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:49.039000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:49.049826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d29954b3-886c-4fd5-b603-f8314bb1e719 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093888 Aug 23 22:52:49.050548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1033/2093] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:49.909539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:49.910099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:49.917760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:49.918234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:49.918665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:49.919338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:49.919782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:49.920257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:50.051722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:50.060428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9367aea6-d481-4d41-b69c-bbfd44cf4666 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154858 Aug 23 22:52:50.061047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1061/2094] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:50.069740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:50.070534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:50.077089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:50.077585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:50.078027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:50.078729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:50.079182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:50.079605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:50.141405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:50.149680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c1b1f778-879e-487e-a718-1320cc143096 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084059 Aug 23 22:52:50.150245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1034/2095] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:51.082832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:51.083449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:51.090105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:51.090584 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:51.091020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:51.091699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:51.092151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:51.092567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:51.169991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:51.170880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:51.177342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:51.177825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:51.178252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:51.178940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:51.179385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:51.179801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:51.222030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:51.231233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d911a435-be37-4734-b38c-e5b137913dcc tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152271 Aug 23 22:52:51.231820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1062/2096] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:51 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:51.245384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:51.253896 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6ef83183-ba12-4cb2-8d53-cd83edba81b7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087698 Aug 23 22:52:51.254550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1035/2097] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:52.253477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:52.254120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:52.261320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:52.261813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:52.262257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:52.262969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:52.263432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:52.263862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:52.276550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:52.277356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:52.284099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:52.284586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:52.285041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:52.285743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:52.286201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:52.286622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:52.362417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:52.371283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0bde85a2-9772-453f-99bc-5ce5c14d8415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.099414 Aug 23 22:52:52.371881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1036/2098] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:52.408943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:52.419500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f804c614-d21e-4957-b906-a12f8036b10a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.169801 Aug 23 22:52:52.420473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1063/2099] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:53.221723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:52:53.222005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:52:53.395364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:53.395953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:53.402870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:53.403357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:53.403787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:53.404468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:53.404911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:53.405351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:53.441718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:53.442333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:53.449131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:53.449616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:53.450048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:53.450869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:53.451341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:53.451931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:53.468368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:53.476605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e3a8ac70-91e7-4200-b19d-7e61c52c9209 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085063 Aug 23 22:52:53.478006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1037/2100] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:53.589066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:53.597219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0bbb7bb-b901-46d1-8a07-237bf6a13783 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159324 Aug 23 22:52:53.597779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1064/2101] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:53 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:52:54.499268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:54.499875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:54.506311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:54.506796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:54.507233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:54.507924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:54.508469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:54.508908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:54.570809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:54.579092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c5494b00-11ba-456b-9db9-9ab71ac253d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083757 Aug 23 22:52:54.579656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1038/2102] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:54.619086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:54.619685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:54.626176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:54.626843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:54.627273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:54.627954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:54.628402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:54.628823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:54.761027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:54.769252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ded12576-b78a-4ad3-898b-0e65896cff18 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154525 Aug 23 22:52:54.769810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1065/2103] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:55.599948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:55.600558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:55.607396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:55.607884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:55.608375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:55.609098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:55.609556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:55.609980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:55.674962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:55.683938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7d1443dd-892d-48a5-aa06-d99e96e82476 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087960 Aug 23 22:52:55.684498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1039/2104] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:55.792260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:55.792874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:55.799687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:55.800172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:55.800610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:55.801331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:55.801813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:55.802237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:55.938766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:55.947517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f314785-336e-4779-bb42-136382b9b51e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159842 Aug 23 22:52:55.948114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1066/2105] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:56.704313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:56.704933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:56.712104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:56.715789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:56.715789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:56.715789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:56.715789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:56.716696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:56.776541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:56.785773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-850d0eed-76db-4e1e-aaf0-a3854814d47a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085410 Aug 23 22:52:56.786283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1040/2106] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:56.970889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:56.971502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:56.978081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:56.978564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:56.979002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:56.979683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:56.980184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:56.980610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:57.110963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:57.120088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd4eaf9d-0d25-4a7e-a18c-3bb576c8f4ee tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153165 Aug 23 22:52:57.120653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1067/2107] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:57.806981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:57.807647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:57.814128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:57.814548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:57.814976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:57.815654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:57.816098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:57.816510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:57.878758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:57.886800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e541e91d-f592-45d3-8199-09c2af8d4ecd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083977 Aug 23 22:52:57.887352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1041/2108] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:58.142094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:58.142705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:58.150031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:58.150512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:58.150946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:58.151679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:58.152129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:58.152552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:58.286419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:58.298035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a653b57-2d2f-4ff8-8932-af45d88088bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159738 Aug 23 22:52:58.298663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1068/2109] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:58 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:58.907781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:58.908397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:58.915062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:58.915587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:58.916351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:58.917260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:58.917720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:58.918149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:58.984085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:58.992282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-664bc1e3-22de-442c-8bb5-5572103f4760 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088371 Aug 23 22:52:58.992844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1042/2110] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:52:59.320481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:52:59.321100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:52:59.328350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:59.328854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:59.329328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:59.330016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:52:59.330467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:52:59.330894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:52:59.464226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:52:59.472502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0cd004fd-6211-4373-b3ce-46be08b49f50 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155982 Aug 23 22:52:59.473095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1069/2111] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:52:59 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:00.013828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:00.014468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:00.020836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:00.021360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:00.021799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:00.022489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:00.022946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:00.023409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:00.093860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:00.103042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e81683a5-a521-49de-8339-e49d44137622 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093039 Aug 23 22:53:00.104299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1043/2112] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:00.496944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:00.503880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:00.505059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:00.505557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:00.505999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:00.506692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:00.507149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:00.507574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:00.648808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:00.657268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f35a537e-12a2-4f0c-a50f-7a0d4d680339 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165044 Aug 23 22:53:00.657830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1070/2113] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:01.125602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.126197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.132608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.133119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.133551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.134286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.134735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.135151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.197843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:01.206133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e7c55318-cb50-40f7-bae5-01f0768c23ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084516 Aug 23 22:53:01.206694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1044/2114] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:01.679688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.680302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.686816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.687302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.687742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.688453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.688904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.689489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.835117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:01.839543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.840057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.845586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-92847712-69c0-4142-96ce-91e0233f2b05 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.169756 Aug 23 22:53:01.846143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.846780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.847194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.847861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.848319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.848746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.851468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:01.855494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1071/2115] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:01.868196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 HTTP/1.1 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:53:01.872764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.874379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '6d1a66ba-0f8a-44f0-8c11-b81be113a633'} Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:53:01.875278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.876958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.878792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:53:01.878792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa511692-f88d-4d0c-9280-70a8ae74d6ef tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 404 len: 111 microversion: 2.1 time: 0.036589 Aug 23 22:53:01.880310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.880814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.882240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1045/2116] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:53:01 2022] DELETE /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:53:01.887621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.888506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.888844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.889317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: 6d1a66ba-0f8a-44f0-8c11-b81be113a633] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.889683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.890574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.891205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.891795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.896643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.897155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.897790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.898491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.898937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.899423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 HTTP/1.1 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 22:53:01.917358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.919403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '6d1a66ba-0f8a-44f0-8c11-b81be113a633'} Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:53:01.920655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. Aug 23 22:53:01.922484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 22:53:01.923938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance 6d1a66ba-0f8a-44f0-8c11-b81be113a633 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:53:01.923938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ee696ec6-2c79-4695-a85f-403883f41440 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633" status: 404 len: 111 microversion: 2.1 time: 0.033635 Aug 23 22:53:01.923938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1046/2117] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:01 2022] GET /compute/v2.1/servers/6d1a66ba-0f8a-44f0-8c11-b81be113a633 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:53:01.926478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:53:01.932928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:01.933487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:01.939554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.940048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.940608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.941226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:01.941680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:01.942112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:01.968913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:53:02.262252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-909aaaf3-3c25-4054-987b-2423e828025c tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 204 len: 0 microversion: 2.20 time: 0.385691 Aug 23 22:53:02.262849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1072/2118] 10.222.0.73 () {60 vars in 1280 bytes} [Tue Aug 23 22:53:01 2022] DELETE /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:53:02.268885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:02.271844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:02.276446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.276927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.277391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.278082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.278539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.278962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.295266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:02.336506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38e34a14-26c0-4015-b4a8-c6d22c6f8aaf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 204 len: 0 microversion: 2.1 time: 0.407217 Aug 23 22:53:02.337865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1047/2119] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 22:53:01 2022] DELETE /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:53:02.343272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:02.344122 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:02.344405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:02.350143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.350631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.351069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.351768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.352222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.352645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.352753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b47be30f-5d6d-409f-a417-455a75881202 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088635 Aug 23 22:53:02.354246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1073/2120] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:02.359789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:02.359974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:02.366810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.367294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.367727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.368429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.369184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.369773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.492373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:02.501309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:02.502865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:02.503397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:02.504037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-157e5c45-3346-4932-808d-a810b7ed15fe tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1725 microversion: 2.20 time: 0.165079 Aug 23 22:53:02.504603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1048/2121] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:53:02 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:53:02.513278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a60d792c-1989-4227-b43e-7a88e2e7abdb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157881 Aug 23 22:53:02.513915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1074/2122] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:02.865778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:02.866388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:02.872862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.874275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.874275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:02.874522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:02.874928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:02.875348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.014764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.023343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-997fba2d-ad71-4eba-afb1-01095f0e52f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161326 Aug 23 22:53:03.023937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1049/2123] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:03.375770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:03.376496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:03.382965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.383462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.383990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.385168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.385670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.386160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.452654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.460928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f11cb3e-f45e-41a2-9335-034b17533e48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089072 Aug 23 22:53:03.461526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1075/2124] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:03.528163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:03.528778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:03.535431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.535931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.536433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.536757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:03.537236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.537428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:03.537693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.538120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.545603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.546091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.546526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.547219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:03.547673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:03.548098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:03.686445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.694753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2db66cbb-fd13-4eaf-9238-e0183c69de3c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161710 Aug 23 22:53:03.695331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1076/2125] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:03.707142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.716838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.718405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:03.719603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9b186ccb-7eb1-456e-add6-0ac021f7ff82 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1725 microversion: 2.20 time: 0.195561 Aug 23 22:53:03.720155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1050/2126] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:53:03 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:53:04.015827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182af6e4-420a-41c2-90ea-a10069ce20af", "name": "network-vif-deleted", "tag": "2bede4e3-6eb7-465b-ad53-8d5dd479f509"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:53:04.026366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.026838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.027262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.039861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] Creating event network-vif-deleted:2bede4e3-6eb7-465b-ad53-8d5dd479f509 for instance 182af6e4-420a-41c2-90ea-a10069ce20af on hv-cinder-84254 Aug 23 22:53:04.043978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-49cf705a-d23b-4746-941b-f11e29fea264 req-b5d3a12c-eaf0-4d58-be6b-a439c48beac9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Aug 23 22:53:04.045192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1077/2127] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 22:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:53:04.046381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:04.047000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:04.053598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.054116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.054773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.055452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.056020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.056703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.216695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.230967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a603268f-a009-4a25-8c85-8d131db4934d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.189543 Aug 23 22:53:04.245195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1051/2128] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:04.482803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:04.483511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:04.490335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.490822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.491255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.491945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.492396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.492821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.559714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.568205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-57193fb9-e241-4b1c-81c6-081082cf3839 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090322 Aug 23 22:53:04.568774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1078/2129] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:04.716528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:04.717390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:04.724019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.724511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.724952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.725686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.726143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.726563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.745212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:04.750933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:04.752918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.753582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.754235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.755750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.756324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.756909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.796758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:04.797323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:04.797663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:04.798992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lazy-loading 'fault' on Instance uuid 182af6e4-420a-41c2-90ea-a10069ce20af {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:53:04.842321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.850656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.852259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eda1fca08b24727929b63318fd6f13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02af2d33ca74bd08365dfc34a6fa77a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.854624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-451ef8fc-ab39-495b-96dd-6cf0087b8742 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 200 len: 1372 microversion: 2.20 time: 0.114673 Aug 23 22:53:04.855235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1079/2130] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:53:04 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:53:04.878375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:04.888072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f09e68f1-1fff-44b3-a118-68af533364f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.175898 Aug 23 22:53:04.888650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1052/2131] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:05.252587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:05.253157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:05.259859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.260335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.260760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.261463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.261907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.262344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.394020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:05.402396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7946c312-7828-41d6-b489-78a3df95e14f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153633 Aug 23 22:53:05.402968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1080/2132] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:05 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:05.589976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:05.590592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:05.596684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.597290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.597729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.598423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.598881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.599307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.662043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:05.671181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ed81451c-e5b5-418e-baeb-6772c59bae66 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085427 Aug 23 22:53:05.671730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1053/2133] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:05.877784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:05.878340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:05.884853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.885379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.885812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.886494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.886967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.887382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.901701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af HTTP/1.1 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 22:53:05.903389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 22:53:05.905241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '182af6e4-420a-41c2-90ea-a10069ce20af'} Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:53:05.906117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 22:53:05.907459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 22:53:05.908741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:53:05.908741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0ad7634c-0af9-476e-9155-ff49070fa3a1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 404 len: 111 microversion: 2.20 time: 0.031016 Aug 23 22:53:05.908741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1081/2134] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 22:53:05 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:53:05.912498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:05.913495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-36183b4b-97f6-479a-8e1f-4659cc67f604 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '.version_select at 0x7f5ed0d8f670>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:05.917509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:05.925410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.925907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.926347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:05.927059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:05.927513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:05.927936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:06.041340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-36183b4b-97f6-479a-8e1f-4659cc67f604 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990070681" status: 204 len: 0 microversion: 2.20 time: 0.130790 Aug 23 22:53:06.042730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1082/2135] 10.222.0.73 () {60 vars in 1262 bytes} [Tue Aug 23 22:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990070681 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:53:06.065893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:06.074154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b82f27c-5585-4472-8b4f-265761727f2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167662 Aug 23 22:53:06.074714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1054/2136] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:06.423828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:06.424439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:06.430573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:06.431239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:06.431688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:06.432383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:06.433490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:06.433490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:06.570728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:06.579631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34b6d66e-6c1f-4674-8051-c3bc9eab5e0c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159969 Aug 23 22:53:06.580422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1083/2137] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:06 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:06.691930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:06.693120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:06.700019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:06.702914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:06.702914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:06.702914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:06.702914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:06.703474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:06.800221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:06.810142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c6c2e036-5b4b-4ae3-a6f8-3e6632831102 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.122092 Aug 23 22:53:06.810691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1055/2138] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:07.096088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:07.096720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:07.103259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.103744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.104227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.104942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.105443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.105882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.234708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:07.242851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0a7e0d13-85bc-46c2-b5ad-56244464df1e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150687 Aug 23 22:53:07.244120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1084/2139] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:07.601881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:07.603138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:07.609864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.610344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.610800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.611488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.611934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.612354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.743343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:07.751798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-64ffb89c-3a6d-4b57-8971-08ea230a699a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153915 Aug 23 22:53:07.752360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1056/2140] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:07.832118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:07.832649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:07.839756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.840240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.840676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.841413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:07.841855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:07.842278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:07.908479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:07.916761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3296c15-e012-403b-a46c-68e07bef1d4a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088670 Aug 23 22:53:07.917355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1085/2141] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:08.264541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:08.265201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:08.267284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:08.272275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.272758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.273233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:08.273926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.274520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.274968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:08.409546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:08.418048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fc4cb08a-a96d-4773-a77b-c72da78e0734 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157789 Aug 23 22:53:08.418619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1057/2142] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:08.773428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:08.774026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:08.780860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.781365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.781796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:08.782466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.782906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.783321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:08.912803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:08.922068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ce883cd8-a7b5-4593-a934-ddfaba150067 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152490 Aug 23 22:53:08.922629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1086/2143] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:08.938007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:08.938626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:08.944993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.945513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.945951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:08.946880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:08.947408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:08.947835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:09.014563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:09.022858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4389e06a-c163-4e64-ab67-45e2668856ba tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088666 Aug 23 22:53:09.023424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1058/2144] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:09.440154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:09.440665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:09.447217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:09.447696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:09.448125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:09.448802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:09.449271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:09.449690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:09.578307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:09.586930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b33e347f-731c-4afd-8b1a-73731d4bb8ce tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150620 Aug 23 22:53:09.588250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1087/2145] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:09.943675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:09.944292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:09.951757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:09.952245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:09.952784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:09.953563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:09.954103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:09.954530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:10.047680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:10.048415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:10.054779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:10.055267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:10.056373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:10.057471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:10.058315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:10.058749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:10.084908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:10.093788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3135501c-477a-4a04-83c3-dbc522a18066 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154112 Aug 23 22:53:10.094361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1059/2146] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:10.127496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:10.136107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d91ee785-f2a6-4aca-83d9-fa523ce0d9cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092609 Aug 23 22:53:10.136676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1088/2147] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:10.609860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:10.610604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:10.616713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:10.617247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:10.617683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:10.618695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:10.619226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:10.619656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:10.747138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:10.755404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-735be6df-8015-4ec0-becd-9e7c2836a9f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149488 Aug 23 22:53:10.755998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1060/2148] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:11.114840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:11.115709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:11.118891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:11.123921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.124396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.124822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.125531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.126026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.126443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.157262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:11.157881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:11.164403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.165307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.165760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.166467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.166926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.167387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.183813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:11.234098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:11.242869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e4583fc2-5282-41c7-829f-b17dd1e1d31a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089646 Aug 23 22:53:11.244332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1061/2149] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:11.261462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:11.269677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cb1ab148-7f1f-47b5-bec0-40d32184f7cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158908 Aug 23 22:53:11.270265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1089/2150] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:11 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:11.777380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:11.777984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:11.784114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.784590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.785034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.785722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:11.786164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:11.786619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:11.916981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:11.925484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e1908777-ae7e-4c30-8a86-ba5d50aea91e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152463 Aug 23 22:53:11.926056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1062/2151] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:12.271719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:12.272350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:12.279552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.280027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.280455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:12.281168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.281612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.282032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:12.291858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:12.292483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:12.299312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.299803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.300250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:12.300954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.301579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.302014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:12.344578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:12.353063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-73f4cd78-fb11-4b2e-911a-a4adcd239d71 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085013 Aug 23 22:53:12.353636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1090/2152] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:12.434423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:12.442669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-356b7b06-aa3b-4bc3-bf12-85334e1f8275 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154888 Aug 23 22:53:12.443237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1063/2153] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:12 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:12.947127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:12.949681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:12.953638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.954116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.954543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:12.955221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:12.955667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:12.956085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:13.088568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:13.096746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf3ecc93-67d7-429e-bb2a-739504c32267 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154101 Aug 23 22:53:13.097337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1091/2154] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:13.374511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:13.375135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:13.381472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:13.381966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:13.382410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:13.383102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:13.383631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:13.384058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:13.448808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:13.457102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-13e1e8d5-4d1a-4eef-9c7b-8b6c0170e580 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086575 Aug 23 22:53:13.457669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1064/2155] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:13.468921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:13.469560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:13.475441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:13.475912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:13.476336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:13.477023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:13.478202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:13.478607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:13.481115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:13.621352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:13.629524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c0acd58b-d348-4df7-b7da-67f1db780725 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.164834 Aug 23 22:53:13.630007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1092/2156] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:13 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:14.119493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:14.120196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:14.126348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.126831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.127269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.127957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.128409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.128833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.262928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:14.272237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eb005bb9-b86f-4aad-96ba-257adc6ea911 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157154 Aug 23 22:53:14.272833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1065/2157] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:14.479222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:14.479838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:14.486470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.486962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.487403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.488126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.488577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.488997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.550892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:14.559829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d319cdfe-1489-4b7c-88c3-081fe50f6657 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085133 Aug 23 22:53:14.560405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1093/2158] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:14.651039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:14.651662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:14.658116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.658601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.659037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.659766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:14.660221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:14.660642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:14.791121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:14.799670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4a72d4a1-c9bb-4545-9287-e814823769cd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152922 Aug 23 22:53:14.800234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1066/2159] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:15.293371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:15.293888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:15.300307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.300788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.301248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.301933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.302379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.302827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.440176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:15.449474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97656b67-5156-4198-9247-5fa826cac4af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160043 Aug 23 22:53:15.450045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1094/2160] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:15.580549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:15.581189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:15.587740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.588230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.588657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.589377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.589822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.590268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.656811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:15.665952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b453df47-7df8-49d9-b865-5d333397548d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089970 Aug 23 22:53:15.666532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1067/2161] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:15.822359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:15.823093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:15.829612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.830082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.830518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.831214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:15.831662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:15.832081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:15.966590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:15.974920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4c082117-7c0e-4ccc-862f-faa7f5cef69c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157105 Aug 23 22:53:15.975727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1095/2162] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:16.471300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:16.471917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:16.478067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:16.478551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:16.478992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:16.479702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:16.480151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:16.480577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:16.609660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:16.618577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1ca22363-891d-4080-9a8c-1187ade383d9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150699 Aug 23 22:53:16.619185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1068/2163] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:16.687943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:16.688653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:16.695141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:16.695615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:16.696654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:16.697356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:16.697803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:16.698218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:16.760732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:16.769262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c142bc58-b1b3-4e44-a060-6380159dd150 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085732 Aug 23 22:53:16.769839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1096/2164] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:16.997206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:16.997817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:17.004234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.004708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.005167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.005851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.006298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.006718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.392380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:17.402172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ee745080-aea7-4bc1-bab2-dc16b23dcd32 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.409626 Aug 23 22:53:17.402765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1069/2165] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:16 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:17.640381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:17.640997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:17.647406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.647868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.648311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.649710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.650336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.650756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.787652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:17.789734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:17.790534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:17.798330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-23491213-9f5f-4f38-95ef-a772bf76f940 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160218 Aug 23 22:53:17.798511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.798637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1097/2166] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:17.798735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.798735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.798735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:17.799046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:17.799518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:17.859867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:17.868922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a4545bfa-087a-4dfe-a4eb-929ea3d8e2dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083241 Aug 23 22:53:17.869498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1070/2167] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:18.424074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:18.424594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:18.431183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.431762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.432198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.432877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.433357 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.433770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.562406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:18.570527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8d000853-a9ca-43f5-aa08-3290c681cb47 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150465 Aug 23 22:53:18.571086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1098/2168] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:18 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:18.818237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:18.818885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:18.825557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.826046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.826589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.827289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.827772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.828198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.889574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:18.890285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:18.896949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.897467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.897900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.898597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:18.899594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:18.900124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:18.959597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:18.963035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:18.969773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e79255c-127e-42cd-a0a8-19e916a66a5b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155442 Aug 23 22:53:18.970460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1071/2169] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:18.971037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b91ecfa9-7dba-4cdc-981e-d498e3e54292 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085688 Aug 23 22:53:18.971752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1099/2170] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:19.592145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:19.592762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:19.598909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:19.599393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:19.599833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:19.600553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:19.601030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:19.601464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:19.737182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:19.745422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-de6e75c4-9aa2-4b4e-a11b-ee6a3629c463 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157238 Aug 23 22:53:19.745987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1072/2171] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:19 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:19.991701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:19.993031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:19.993327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:19.994775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:20.001138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.001496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.001699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.002126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.002349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.002828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.003042 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.003289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.003718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.003909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.004479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.005053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.078194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:20.088666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e32603c6-246b-459d-b039-e0beea159895 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.099234 Aug 23 22:53:20.089666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1073/2172] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:20.171337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:20.180254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8dd5f32a-4d8f-445b-86a7-8d35af1ba670 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.192500 Aug 23 22:53:20.181403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1100/2173] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:20.767733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:20.768367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:20.776129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.776609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.777056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.777746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:20.778189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:20.778603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:20.923934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:20.936441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-12739f8d-412a-44b2-ad30-6695b4590c94 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.172652 Aug 23 22:53:20.937046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1074/2174] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:21.110452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:21.111062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:21.117628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.118054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.119113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:21.119846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.120302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.120729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:21.183910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:21.192179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-33101bf9-8246-4330-b4e4-a5164c2c57ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085811 Aug 23 22:53:21.192746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1101/2175] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:21.202492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:21.203104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:21.209732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.210262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.210696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:21.211371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.211820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.212304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:21.345994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:21.355143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0cc1817e-b14b-49cc-a172-f1157c011992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156537 Aug 23 22:53:21.355808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1075/2176] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:21.958835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:21.959446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:21.966527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.967161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.967549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:21.968233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:21.968688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:21.969143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:22.099846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:22.108765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a33c11ab-ed63-444b-a4f8-8428e7a8e5a7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153896 Aug 23 22:53:22.109374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1102/2177] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:22.214085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:22.214614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:22.220964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:22.221472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:22.221899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:22.222571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:22.223014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:22.223432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:22.285333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:22.294303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6df7df9d-0c7c-4b29-9191-cde3939915cc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083923 Aug 23 22:53:22.294853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1076/2178] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:22.376576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:22.377212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:22.383703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:22.384245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:22.384680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:22.385387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:22.385835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:22.386246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:22.516010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:22.524071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd8cab8a-314c-40fa-a7b4-5536c39c2baa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151366 Aug 23 22:53:22.525251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1103/2179] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:23.131181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:23.132140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:23.138469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.138966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.139400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.140185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.140654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.141128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.268765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:23.277556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8712bfb9-0708-4968-bf8e-7ea7aa33e8e2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150350 Aug 23 22:53:23.278131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1077/2180] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:23 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:23.315554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:23.316217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:23.322364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.322847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.323291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.323977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.324434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.324859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.386013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:23.394301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-14f64099-8e9b-407f-9850-cd8bcaea8109 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082702 Aug 23 22:53:23.394874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1104/2181] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:23.545630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:23.546282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:23.552397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.552882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.553359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.554055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:23.554543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:23.554970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:23.557950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:23.687236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:23.695717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-910ebf0e-5f5a-4e90-8d27-654b8737b371 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154377 Aug 23 22:53:23.696288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1078/2182] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:24.299572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:24.300184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:24.306255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.306735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.307204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.308526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.308987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.309479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.414801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:24.415598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:24.423290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.423782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.429468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.429468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.429468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.429468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.444996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:24.453885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a2ff33b-ce20-4d50-8592-067c9d2b7ed3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158240 Aug 23 22:53:24.454470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1105/2183] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:24 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:24.490560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:24.499663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ccfc9c4e-c5b5-4ce0-a90c-06b647aa1a59 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088791 Aug 23 22:53:24.500249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1079/2184] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:24.717479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:24.718124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:24.724067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.724551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.724988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.725765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:24.726218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:24.726642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:24.859420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:24.868002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5e94c72b-0f23-4c65-a81c-9025f4a37dab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154519 Aug 23 22:53:24.868579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1106/2185] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:25.475945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:25.476541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:25.484000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.484492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.484930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:25.485671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.486129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.486565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:25.519893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:25.520581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:25.527873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.528504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.528948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:25.529676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.530134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.530562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:25.601190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:25.610197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f3a249e-f45d-40de-8cef-7f5c11d7e5ea tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094170 Aug 23 22:53:25.610771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1107/2186] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:25.629390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:25.637670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8480eb98-f4e9-4d6e-8db2-ff969dfc5843 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165668 Aug 23 22:53:25.638237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1080/2187] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:25 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:25.891125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:25.891651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:25.897580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.898067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.898502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:25.899186 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:25.899636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:25.900061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:26.032359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:26.034583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:26.041140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8f6075ff-1188-4c3e-88f2-2e1927d13d79 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154047 Aug 23 22:53:26.041715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1108/2188] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:26.631171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:26.631772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:26.638298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:26.638782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:26.639214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:26.639893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:26.640339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:26.640752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:26.659219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:26.659828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:26.666254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:26.666739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:26.667687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:26.668369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:26.669293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:26.669715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:26.706618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:26.716102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cf0f5f30-4026-4f04-b6e6-e3be7a642c2d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088706 Aug 23 22:53:26.716835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1081/2189] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:26.802703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:26.811053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9787ad88-9526-4dda-9155-c5ec7e359894 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156006 Aug 23 22:53:26.811557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1109/2190] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:27.062570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:27.063370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:27.069254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.069728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.070157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.070832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.071272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.071684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.198115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:27.206964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-681cb74a-f8b2-4697-a6be-c05865b2f97b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.148313 Aug 23 22:53:27.207528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1082/2191] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:27.736970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:27.737603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:27.744191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.744697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.745709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.746428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.746879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.747325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.810947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:27.819217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19ae8963-baa1-41fb-981f-e82d705aca5f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086295 Aug 23 22:53:27.819782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1110/2192] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:27.831557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:27.832180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:27.838600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.839324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.839949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.840642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:27.841133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:27.841578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:27.974691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:27.983239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-42d23caa-9f3d-4f45-bbff-6d7c09b08ab4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155489 Aug 23 22:53:27.983829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1083/2193] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:28.228671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:28.229300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:28.235961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:28.236439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:28.236867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:28.237567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:28.238007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:28.238418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:28.368637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:28.377665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fcdaabcb-2a49-49ec-9e27-4af21ab6dada tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152746 Aug 23 22:53:28.378246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1111/2194] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:28.841582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:28.842119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:28.849096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:28.849680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:28.850133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:28.850937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:28.851389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:28.851803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:28.914564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:28.923270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-19c2d2ec-d7ca-4896-8bbd-073f566bd7b9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086449 Aug 23 22:53:28.923825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1084/2195] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:29.006816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:29.007563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:29.015961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.016480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.016987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:29.017912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.018422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.018925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:29.164582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:29.173201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-82a54be9-021e-4fc7-8c59-9d3212ee08a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.171295 Aug 23 22:53:29.173774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1112/2196] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:29 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:29.398522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:29.399047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:29.405160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.405648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.406083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:29.406769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.407244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.407669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:29.537121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:29.546341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2984827c-fdb1-4aa9-b233-1521144b5fe1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151963 Aug 23 22:53:29.546909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1085/2197] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:29.943670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:29.944292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:29.950372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.950860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.951301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:29.952028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:29.952487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:29.952914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:30.014872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:30.022971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dbdb992c-44e8-4d66-8418-0877aee87078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083287 Aug 23 22:53:30.023804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1113/2198] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:30.194938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:30.195554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:30.202503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:30.202988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:30.203429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:30.204116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:30.204569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:30.204997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:30.337377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:30.346327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-86e238f2-7e9f-4fea-947a-1ed5fbd3eb02 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155259 Aug 23 22:53:30.346905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1086/2199] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:30 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:30.567839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:30.572563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:30.575267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:30.575755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:30.576190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:30.576881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:30.577370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:30.577792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:30.712826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:30.721451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d19086b-1ab6-44e4-a2f2-22f33a2a2450 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157400 Aug 23 22:53:30.722040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1114/2200] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:31.044595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:31.045245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:31.051227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.051714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.052150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.052839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.053334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.053760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.116463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:31.125710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ba7d0685-cc3a-44f6-a26f-81ec134e51ae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085830 Aug 23 22:53:31.126286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1087/2201] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:31.367592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:31.368166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:31.375083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.375570 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.376008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.376700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.377193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.377621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.508562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:31.516884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f75742c-5f9f-4bdd-acd0-978282c920a5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153261 Aug 23 22:53:31.517482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1115/2202] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:31 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:31.743171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:31.743822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:31.750772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.751354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.751695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.752384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:31.752839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:31.753294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:31.883308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:31.892240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e8d77092-ef9e-48d9-ae49-c2de9f1cb1ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152898 Aug 23 22:53:31.897472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1088/2203] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:32.146681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:32.147287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:32.153634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.154270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.154709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:32.155393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.155841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.156293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:32.220417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:32.229062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-204e9539-8d01-4676-820b-33e1dc9e8850 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086318 Aug 23 22:53:32.229636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1116/2204] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:32.538751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:32.539367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:32.546115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.546599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.547032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:32.547721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.548173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.548595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:32.681810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:32.691927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1d1f844d-c38d-4366-9ba0-44820501714a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155755 Aug 23 22:53:32.691927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1089/2205] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:32.914332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:32.914892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:32.922238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.922728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.923166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:32.923854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:32.924308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:32.924731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:33.056703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:33.066204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6b1e8c12-7a86-4d28-a70d-07a3f596054a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155723 Aug 23 22:53:33.066790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1117/2206] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:33.250103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:33.250899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:33.256586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:33.257106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:33.257544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:33.258227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:33.258677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:33.259101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:33.321370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:33.330529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38eb04cd-df8b-495b-9daa-cb40ee1064da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084794 Aug 23 22:53:33.331096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1090/2207] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:33.712459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:33.713096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:33.719336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:33.719840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:33.720406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:33.721114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:33.721569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:33.721989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:33.855399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:33.865410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-98ea6517-e060-4e81-a5ca-c3764609c212 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156911 Aug 23 22:53:33.866497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1118/2208] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:34.087933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:34.088445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:34.094522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.095017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.095445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:34.096119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.096560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.096974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:34.228456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:34.237588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a6f87b6-7eb7-4ab6-b01e-548b1d83cbbb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153758 Aug 23 22:53:34.238170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1091/2209] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:34.351842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:34.352407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:34.359608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.360096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.360534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:34.361264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.361721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.362149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:34.428105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:34.436550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-487c6951-87a0-480d-bcc1-50ca0ba81b53 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088678 Aug 23 22:53:34.437139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1119/2210] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:34.887676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:34.888303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:34.895026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.895497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.895925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:34.896597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:34.897059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:34.897477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:35.032165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:35.040434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a232ecb4-d8cb-48e9-ab18-5be5a15f6673 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156661 Aug 23 22:53:35.041000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1092/2211] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:35.259457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:35.260073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:35.266950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:35.267434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:35.267871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:35.268556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:35.269025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:35.269608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:35.397405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:35.405724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-635626bf-f568-46e1-8867-d1e69035236f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150317 Aug 23 22:53:35.406293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1120/2212] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:35.456632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:35.457266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:35.463686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:35.464165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:35.464599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:35.465312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:35.465769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:35.466190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:35.528456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:35.536624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-53284b09-a607-4974-b1f4-f87fbc307c20 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083927 Aug 23 22:53:35.537217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1093/2213] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:36.062255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:36.062901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:36.068951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.069494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.069938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.070627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.071079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.071502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.203380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:36.211433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cbb88022-904d-4d2d-8ee5-d4787fb50f70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153355 Aug 23 22:53:36.211993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1121/2214] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:36.427000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:36.427627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:36.433440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.433914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.434339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.435010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.435612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.436029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.558401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:36.559090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:36.566352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.566941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.567471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.567937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:36.568365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:36.568889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:36.569402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:36.571321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:36.577119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-807a6aca-fdce-482f-8e8c-4e6236fe41b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153480 Aug 23 22:53:36.577684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1094/2215] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:36.636671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:36.645512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6dee3639-1bf0-4a32-91cb-57ddebe79450 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091365 Aug 23 22:53:36.646075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1122/2216] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:37.234478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:37.235086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:37.241434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.241923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.242398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.243050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.243540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.243966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.372711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:37.380223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8b86998-a923-45a5-bbdb-e6294a2ea3f4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150435 Aug 23 22:53:37.380785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1095/2217] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:37 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:37.598807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:37.599424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:37.605896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.606382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.606819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.607527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.607960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.608382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.666315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:37.667057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:37.673840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.674328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.674761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.675683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:37.675943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:37.676398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:37.739707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:37.740259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:37.748128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e8d16052-de39-4a22-98c5-2bf8f900e692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085622 Aug 23 22:53:37.748492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5175ca66-4221-46e1-a787-d29eb2ad0a6a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153721 Aug 23 22:53:37.748806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1096/2218] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:37.749713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1123/2219] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:38.099892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:53:38.100144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:53:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:53:38.401597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:38.402126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:38.403986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=80 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:38.409031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.409637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.409956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.410649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.412243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.412243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.549628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:38.557967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d68ec447-8fee-4b07-bc8f-45a9d2e634c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160295 Aug 23 22:53:38.558524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1097/2220] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:38 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:38.768894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:38.769486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:38.769874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:38.770007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:38.775951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.776238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.776429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.776715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.776864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.777181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.777573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.777914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:38.778082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.778367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:38.778521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.778788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:38.841777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:38.850618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d9ccb0f1-8459-4c2d-93d4-5592c5185e52 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085599 Aug 23 22:53:38.851384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1124/2221] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:38.910124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:38.918459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-04350cbc-4cc8-42b9-a7f5-82b847e97025 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152766 Aug 23 22:53:38.919010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1098/2222] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:39.581144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:39.581755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:39.587833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.588296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.588723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.589426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.589871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.590283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.605261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:39.723118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:39.731303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f9f0c679-ecf2-4534-83a9-11899f958347 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155238 Aug 23 22:53:39.731870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1125/2223] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:39.871860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:39.872438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:39.879519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.880004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.880442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.881155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.881610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.882034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.939823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:39.940413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:39.944434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:39.946553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.947033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.947463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.948176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:39.948620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:39.949061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:39.954234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-adbaa2dc-1e22-471b-bdd7-27e89a88e270 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086293 Aug 23 22:53:39.954828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1099/2224] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:40.080095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:40.088242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f978ab03-2e37-40c7-9596-bf765218e353 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152977 Aug 23 22:53:40.088809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1126/2225] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:40.752631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:40.753469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:40.759552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:40.760032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:40.760467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:40.761213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:40.761668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:40.762091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:40.893342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:40.901552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d6212536-be2c-466e-bfc3-a4344888a7cb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152814 Aug 23 22:53:40.902117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1100/2226] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:40 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:40.975420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:40.976091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:40.982832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:40.983316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:40.983799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:40.984499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:40.984955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:40.985407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:41.046823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:41.055107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a7b47d12-d4a6-47ce-b25d-20391dad1852 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083676 Aug 23 22:53:41.055680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1127/2227] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:41.109554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:41.110127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:41.116072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:41.116606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:41.117069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:41.117764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:41.118216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:41.118643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:41.247798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:41.256689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8f8118e-a22a-4e49-97ef-30b9696e036a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151283 Aug 23 22:53:41.257278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1101/2228] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:41.923525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:41.924046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:41.925938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:41.930634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:41.931105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:41.931555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:41.932280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:41.932733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:41.933182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:42.064602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:42.072974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-56b3d867-0fad-4e0e-92e7-9e8a323dd244 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153523 Aug 23 22:53:42.073565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1128/2229] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:42.078664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:42.079192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:42.085554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:42.086040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:42.086479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:42.087166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:42.087613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:42.088036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:42.148863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:42.157450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-70719b53-074a-4f28-bb62-bce3ce7d4269 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083273 Aug 23 22:53:42.158023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1102/2230] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:42.278063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:42.278693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:42.284825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:42.285331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:42.285762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:42.286430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:42.286873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:42.287291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:42.417392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:42.426636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe525023-74d1-4d0c-b6e0-e54e80bb619f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152507 Aug 23 22:53:42.427209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1129/2231] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:43.094245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:43.095473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:43.102182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.102665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.103106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.103853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.104315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.104817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.178712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:43.179303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:43.187236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.187549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.187970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.188667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.189144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.189564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.238843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:43.247694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cc35c429-10d4-4b0b-ae42-5a565ac3740b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157368 Aug 23 22:53:43.248272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1103/2232] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:43.253035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:43.261453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-10ab4a84-9fd6-4444-84a3-70fb55a673ca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086640 Aug 23 22:53:43.262007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1130/2233] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:43.447896 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:43.448511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:43.455352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.455837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.456271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.456962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:43.457451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:43.457873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:43.590314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:43.598885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d386f8c1-0470-457b-ad4b-88f771473d3a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155056 Aug 23 22:53:43.599457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1104/2234] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:44.269787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:44.270381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:44.276731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.277244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.277757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.278445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.278887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.279311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.283167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:44.283783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:44.289892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.290391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.290872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.291566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.292022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.292445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.355742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:44.364449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3979d832-1830-4dc2-9d87-0cc71ae161cb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085582 Aug 23 22:53:44.365048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1105/2235] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:44.413921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:44.422827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4ff38ff-7745-43fd-9cce-449edea5af2e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156914 Aug 23 22:53:44.423399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1131/2236] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:44.619905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:44.620544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:44.626738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.627223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.627662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.628358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:44.628811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:44.629268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:44.760223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:44.769331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce4f96b4-14c4-43fb-8806-69af2d60d7e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153267 Aug 23 22:53:44.769901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1106/2237] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:45.385397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:45.386010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:45.392717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.393239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.393679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.394369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.394823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.395256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.444651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:45.445409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:45.452118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.452606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.453067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.453760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.454216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.454630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.458240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:45.466862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3f0ef4a-52aa-4b84-ad08-c744ad6a4560 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085270 Aug 23 22:53:45.468022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1132/2238] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:45.586814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:45.595727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c41da784-2d63-4afc-85ef-6e20402cecdd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155035 Aug 23 22:53:45.596292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1107/2239] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:45 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:45.790456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:45.791068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:45.798013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.798505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.798942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.799637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:45.800089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:45.800513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:45.929305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:45.937600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-04c3b202-0eb4-4818-bfcf-5d0f86c0a30f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151058 Aug 23 22:53:45.938215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1133/2240] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:46.488173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:46.488770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:46.495386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.495871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.496308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:46.496996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.497470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.497989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:46.564223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:46.572531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4e26d1ce-6569-4fae-934c-2ad7ecf0a42d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088268 Aug 23 22:53:46.573110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1108/2241] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:46.617691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:46.618303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:46.625353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.625839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.626287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:46.627016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.627469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.627894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:46.760040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:46.769144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-05020b5b-ae39-4c79-a351-375bf153ff97 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155311 Aug 23 22:53:46.770889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1134/2242] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:46.958994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:46.959611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:46.965592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.966177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.966583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:46.967769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:46.968287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:46.968725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:47.097380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:47.105581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-efdf757b-cdaa-4fde-b1ee-dd07611a95d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150543 Aug 23 22:53:47.106143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1109/2243] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:47.594791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:47.595396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:47.601595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:47.602109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:47.602550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:47.603241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:47.603694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:47.604119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:47.665881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:47.674715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-17bae6c3-3771-4541-9c6f-6a4afb806d46 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084504 Aug 23 22:53:47.675315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1135/2244] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:47.790810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:47.791415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:47.798161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:47.798687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:47.799117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:47.799829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:47.800278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:47.800699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:47.928593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:47.937327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5ef42a61-89de-4192-9447-8183c1c382d2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150447 Aug 23 22:53:47.937887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1110/2245] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:47 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:48.128219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:48.128752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:48.134742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.135222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.135655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:48.136337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.136787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.137334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:48.272263 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:48.280411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-889ba5a5-b85e-47df-8292-ec617ace67af tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156909 Aug 23 22:53:48.280974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1136/2246] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:48.695758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:48.696367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:48.702648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.703123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.703555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:48.704234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.704687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.705143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:48.720584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:48.773420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:48.782671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a5d293ed-6fdd-400d-b9d3-978786399ff5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090617 Aug 23 22:53:48.783238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1111/2247] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:48.958262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:48.958879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:48.965343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.965825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.966262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:48.967561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:48.968015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:48.968471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:49.101655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:49.109916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-140a719c-0d73-4a8e-a74e-253cb1f2a45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155506 Aug 23 22:53:49.110473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1137/2248] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:49.301678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:49.302240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:49.308835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:49.309411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:49.309840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:49.310520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:49.311488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:49.311905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:49.440579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:49.448913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0a9a64d3-a06f-4f09-bbbe-3430304d5aec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151285 Aug 23 22:53:49.449507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1112/2249] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:49.804283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:49.804926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:49.811124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:49.811740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:49.812183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:49.812866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:49.813347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:49.813776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:49.874202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:49.882393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-646b0a0e-3378-480c-990f-d06861a94442 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.081989 Aug 23 22:53:49.882958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1138/2250] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:50.131424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:50.131997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:50.138341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.138495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.139530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.140348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.140811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.141266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.271007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:50.279465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-88d7c397-d6c3-4e4e-9190-037d1579f2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151975 Aug 23 22:53:50.280052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1113/2251] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:50.470295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:50.470935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:50.477425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.477912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.478350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.479039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.479491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.479916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.616129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:50.625378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4fee317-21db-426a-9805-11591d758435 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159146 Aug 23 22:53:50.625949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1139/2252] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:50.903652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:50.904221 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:50.911190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.911667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.912100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.912803 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:50.913279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:50.913697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:50.987433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:50.995632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-24470d73-0113-435e-a645-124b77582110 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.095933 Aug 23 22:53:50.996214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1114/2253] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:51.300688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:51.301364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:51.307344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:51.307828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:51.308272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:51.308956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:51.309438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:51.309860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:51.439475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:51.447891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7b59c3d6-0a6e-4ca2-8002-3839cccb3abf tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151089 Aug 23 22:53:51.448457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1140/2254] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:51 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:51.646268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:51.646886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:51.652805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:51.653319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:51.653760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:51.654452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:51.654901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:51.655321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:51.782667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:51.790951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4087f8fc-d76d-40d7-9580-b8363e90aa2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.148612 Aug 23 22:53:51.791567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1115/2255] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:52.017115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:52.017732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:52.024227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.024742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.025220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.025928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.026382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.026809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.091268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:52.099702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-134f932c-debe-49ae-a8c3-5b3d02849e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086472 Aug 23 22:53:52.100310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1141/2256] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:52.470797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:52.471411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:52.477883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.478362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.478830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.479523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.480104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.480532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.613469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:52.621842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-05e3aec4-0d97-4b80-baee-d14a8699a772 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155723 Aug 23 22:53:52.622405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1116/2257] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:52.814380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:52.814896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:52.820792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.821294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.821726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.822399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:52.822846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:52.823261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:52.827872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:53:52.953750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:52.961948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a0249b1f-1e22-43a1-a7c5-35248b86c400 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151536 Aug 23 22:53:52.962517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1142/2258] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:53.121512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:53.122035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:53.128521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.128999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.129460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:53.130244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.130695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.131108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:53.195702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:53.204594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-573e0003-9972-4873-add4-783833fa1520 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087002 Aug 23 22:53:53.205174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1117/2259] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:53.643344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:53.643955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:53.650364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.650840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.651292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:53.651949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.652400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.652818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:53.781374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:53.789621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-399044d6-b6de-4571-a340-856d9664bb9b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150190 Aug 23 22:53:53.790190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1143/2260] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:53 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:53.983919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:53.984566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:53.991046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.991531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.991975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:53.992661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:53.993137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:53.993563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:54.120050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:54.128396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f0d8e252-8764-4358-91aa-60305dcc1db5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149092 Aug 23 22:53:54.128967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1118/2261] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:54.224765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:54.225410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:54.231514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:54.231985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:54.232427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:54.233145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:54.233600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:54.234091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:54.294865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:54.303066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-75efa68c-4871-426f-b935-98b9d378a0d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082199 Aug 23 22:53:54.303631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1144/2262] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:54.813049 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:54.813595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:54.819738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:54.820223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:54.820667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:54.821391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:54.821845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:54.822269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:54.951825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:54.960241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-64ea0b00-0890-4fb2-885d-c4b4fa560a29 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151953 Aug 23 22:53:54.960813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1119/2263] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:55.151194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:55.151902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:55.160190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.160687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.161170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:55.161904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.162388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.162812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:55.299112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:55.307343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1319ef1b-8edb-4b37-acf5-5b5a82bdf736 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161054 Aug 23 22:53:55.307896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1145/2264] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:55.323602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:55.324207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:55.330734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.331191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.331618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:55.332294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.332742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.333200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:55.399211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:55.407901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f57c1ae4-4670-4405-8e6f-568a8faceaf6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088177 Aug 23 22:53:55.408397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1120/2265] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:55.982065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:55.982672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:55.988850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.989364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.989796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:55.990461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:55.990900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:55.991315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:56.119578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:56.128827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a30fe5d1-5bf6-47c1-8b12-54c2d862f58b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150558 Aug 23 22:53:56.129478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1146/2266] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:56.328374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:56.328962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:56.335501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:56.335985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:56.336426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:56.337140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:56.337598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:56.338024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:56.429385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:56.430005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:56.436960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:56.437484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:56.437926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:56.438626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:56.439081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:56.439538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:56.466873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:56.475915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9f43fc98-0598-4053-9484-6cedfaa27fee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151983 Aug 23 22:53:56.476497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1121/2267] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:56.502137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:56.510424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b70eca05-0514-4ad4-b84a-94e19cc8919e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084980 Aug 23 22:53:56.510988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1147/2268] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:57.151665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:57.152308 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:57.158904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.159383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.159827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.160513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.160967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.161424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.291736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:57.300321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a1896df-3881-4a5c-b155-a7492b8c6a06 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152506 Aug 23 22:53:57.300887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1122/2269] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:57.498502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:57.499176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:57.505662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.506141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.506574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.507253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.507701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.508119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.531846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:57.532448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:57.539009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.550095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.550095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.550095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:57.550095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:57.550592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:57.606889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:57.616066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-36463422-302b-4eb7-8d94-858fbe7fd8bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088734 Aug 23 22:53:57.616641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1123/2270] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:57.651767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:57.651767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-10cc8537-5556-42e3-9f0e-979dd5cd4551 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157172 Aug 23 22:53:57.652230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1148/2271] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:58.321619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:58.322223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:58.328854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.329355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.329781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.330457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.330902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.331317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.458531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:58.466724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9340e459-9486-4478-9d0f-aa9605845b28 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.148896 Aug 23 22:53:58.467285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1124/2272] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:58 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:58.637505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:58.638044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:58.645104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.645513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.645945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.646623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.647057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.647474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.673930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:58.674717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:58.681242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.681738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.682178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.682878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:58.683334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:58.683763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:58.709491 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:58.718599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-95b9782e-8472-4168-a75a-27dff1486ebd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084291 Aug 23 22:53:58.719594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1149/2273] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:53:58.814655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:58.822818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dce70403-9763-4b6c-b55a-c118dc097027 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152953 Aug 23 22:53:58.823393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1125/2274] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:59.489310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:59.489931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:59.496175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.496711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.497210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.497936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.498388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.498839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.630158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:59.638434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-14cc1389-998b-4c44-8953-cd67414f39ce tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153183 Aug 23 22:53:59.639016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1150/2275] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:59 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:59.740457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:59.741159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:59.748788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.749474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.749958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.750742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.751231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.751686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.820038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:59.829744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d92849c7-034b-47ef-ab59-7810096e2737 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093500 Aug 23 22:53:59.830377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1126/2276] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:53:59.844394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:53:59.845060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:53:59.851559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.852040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.852481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.853211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:53:59.853668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:53:59.854092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:53:59.982156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:53:59.990881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6efa7a8c-aa8d-4558-9b1f-e5135317eeba tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151044 Aug 23 22:53:59.991375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1151/2277] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:53:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:00.660226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:00.662460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:00.666969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:00.667704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:00.668133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:00.668914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:00.669386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:00.669811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:00.800542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:00.809094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bd32bf74-5fde-48c0-8c3e-258d08a546ff tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152609 Aug 23 22:54:00.809580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1127/2278] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:00.851702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:00.852375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:00.859332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:00.859817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:00.860245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:00.860925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:00.861395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:00.861811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:00.927610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:00.935918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-397b70f1-bc33-4a29-9c22-fca17222885e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088051 Aug 23 22:54:00.937197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1152/2279] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:01.011215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:01.011833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:01.018329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.018816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.019256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.019950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.020404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.020830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.023385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:01.155794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:01.164030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-58fa98bf-8f4f-48ec-9b37-3b895c3a673f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156804 Aug 23 22:54:01.164607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1128/2280] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:01.831206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:01.831764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:01.837707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.838190 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.838629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.839310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.839762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.840183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.960924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:01.961549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:01.967712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.968265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.968866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.969600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:01.970053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:01.970472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:01.973685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:01.982845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a33ac98-7759-4658-a331-5eed72b3de1c tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155278 Aug 23 22:54:01.982845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1153/2281] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:02.040282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:02.048945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9bb04f4c-1bb4-4c9f-9ef4-5d50f4ea6b47 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093167 Aug 23 22:54:02.049573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1129/2282] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:02.185403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:02.186027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:02.192766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:02.193301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:02.193740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:02.194427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:02.194877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:02.195298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:02.325264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:02.333539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-844f4343-aba9-4842-8c4d-52f5859a32d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151975 Aug 23 22:54:02.334112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1154/2283] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:03.003269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:03.011732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:03.011732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.011732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.011732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.012185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.012288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.012669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.082641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:03.083292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:03.089915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.090422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.090850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.091902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.092003 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.092944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.145328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:03.153844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d0325642-894f-4fbc-b351-acebd8193d0d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154785 Aug 23 22:54:03.154495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1130/2284] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:03.160505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:03.168979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0a7cb616-300e-4527-9730-868991f1f6a6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090224 Aug 23 22:54:03.169556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1155/2285] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:03.356880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:03.357436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:03.364201 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.364682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.365150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.365831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:03.366285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:03.366703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:03.499071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:03.507782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ca608d6-8388-4be5-b120-8ea0b160afbc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154811 Aug 23 22:54:03.508401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1131/2286] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:04.175934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:04.176543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:04.182887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.183358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.183785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.184457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.184990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.185461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.190795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:04.191400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:04.197322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.197812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.198243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.198924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.199369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.199783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.262307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:04.271442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b67b215-4de5-428a-bb3f-3e4764202677 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085146 Aug 23 22:54:04.272021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1132/2287] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:04.323626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:04.332300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-27210762-62fe-4678-b40e-8b9891f10b0e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160066 Aug 23 22:54:04.332874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1156/2288] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:04.530135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:04.530738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:04.536673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.537200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.537629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.538303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:04.538745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:04.539160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:04.665893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:04.675029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ba8ae4a-1247-4814-a4fd-976067e87b7e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.148737 Aug 23 22:54:04.675592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1133/2289] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:05.292379 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:05.292976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:05.302222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.302758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.303198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.303893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.304351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.304838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.354454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:05.355062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:05.361939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.362430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.362865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.363561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.364012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.364441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.378322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:05.387259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aa82ba3e-b399-40ad-b2d4-ce6ff2f52086 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.098621 Aug 23 22:54:05.389868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1157/2290] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:05.504808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:05.513079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-85b47e71-875b-4762-a05d-02984672ef95 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.162628 Aug 23 22:54:05.513646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1134/2291] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:05 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:05.695933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:05.696554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:05.703389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.703878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.704315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.705035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:05.705496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:05.705925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:05.834434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:05.836595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:05.843234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a887fc2f-ff3d-4d3b-8719-db46a6482bde tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151299 Aug 23 22:54:05.843801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1158/2292] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:06.409273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:06.409848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:06.416227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.416719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.417436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:06.418126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.418585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.419014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:06.482264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:06.491224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2aa9b59c-035e-48a3-b090-7611005bcc9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087039 Aug 23 22:54:06.491792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1135/2293] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:06.535490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:06.536105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:06.542872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.543354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.543817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:06.544499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.544950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.545401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:06.677111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:06.685590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-22166ba9-6d39-4fc3-85ff-c4e1c4be054a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154672 Aug 23 22:54:06.686173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1159/2294] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:06 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:06.864622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:06.865258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:06.871450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.871929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.872403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:06.873107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:06.873564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:06.873984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:07.007865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:07.016711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2987a5df-bef3-4d7f-be93-c32125f72a95 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156166 Aug 23 22:54:07.017379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1136/2295] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:07.513870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:07.514559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:07.520912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:07.521433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:07.521880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:07.522618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:07.523068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:07.523495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:07.586800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:07.595897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8f6320de-c772-45d5-8e0c-6a424ed9fdca tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088047 Aug 23 22:54:07.596460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1160/2296] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:07.707125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:07.707742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:07.714329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:07.714819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:07.715260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:07.715944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:07.716400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:07.716823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:07.848774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:07.854214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-48e11f1a-cf5c-4e26-b282-7e4178a7de14 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150946 Aug 23 22:54:07.854787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1137/2297] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:08.038302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:08.038912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:08.045171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.045587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.046016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:08.046752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.047204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.047610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:08.176174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:08.184402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aec7ade4-73e3-4ac7-bb8b-171737ea823f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149949 Aug 23 22:54:08.184965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1161/2298] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:08.616077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:08.616692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:08.618601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=82 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:08.623390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.623883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.624321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:08.625671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.626294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.626719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:08.690793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:08.698993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e572a387-91f8-41df-95d8-9dacc4600c2f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086800 Aug 23 22:54:08.699571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1138/2299] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:08.876858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:08.877470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:08.883862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.884346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.884782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:08.885547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:08.886005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:08.886426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:09.018748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:09.026970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b8ab6074-1439-4292-8baf-cd799bbe1a2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155014 Aug 23 22:54:09.027548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1162/2300] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:09.206195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:09.206802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:09.213253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:09.213732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:09.214159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:09.214837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:09.215281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:09.215696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:09.349252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:09.357527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c2f041bd-7529-473d-a601-edd55198af54 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155381 Aug 23 22:54:09.358099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1139/2301] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:09.720392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:09.721036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:09.727280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:09.727762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:09.728203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:09.728885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:09.729370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:09.729796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:09.790609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:09.799274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f9435762-fc15-467d-9d47-1540d5359dc3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083510 Aug 23 22:54:09.799999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1163/2302] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:10.048227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:10.048834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:10.055092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.055570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.056005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.056685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.057211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.057648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.187017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:10.196415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57d15e02-77e4-405c-b0db-c201f8da0f93 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152153 Aug 23 22:54:10.196983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1140/2303] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:10 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:10.380333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:10.380885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:10.387402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.387889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.388326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.389033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.389486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.389914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.521801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:10.530284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-168a381b-4855-41fe-a4f5-48a5cbe8d91f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153845 Aug 23 22:54:10.531498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1164/2304] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:10.821609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:10.822248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:10.829622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.830109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.830548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.831235 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:10.831690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:10.832115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:10.893853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:10.901979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-11e400e1-f9cd-4d40-9aee-dc450bd83cc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084394 Aug 23 22:54:10.902542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1141/2305] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:11.217543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:11.218157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:11.224766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.225270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.225711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.226392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.226871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.227290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.354813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:11.363119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9d5dab66-d38a-432d-bf2d-7853d84ac907 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.149553 Aug 23 22:54:11.363690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1165/2306] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:11 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:11.552797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:11.553413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:11.559443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.559944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.560372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.561099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.561551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.562475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.693057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:11.701211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-054a96ff-8120-44e3-8651-0feddedb68ed tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152322 Aug 23 22:54:11.701779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1142/2307] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:11.924000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:11.924637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:11.931241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.931723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.932159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.932847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:11.933321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:11.933740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:11.994969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:12.004103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfee93be-f0b4-4ddf-89da-c0ea054b4832 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084921 Aug 23 22:54:12.004711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1166/2308] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:12.384878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:12.385553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:12.392733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:12.393247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:12.393682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:12.394450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:12.394900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:12.395319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:12.525218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:12.534198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3537b674-f87e-430a-a477-03c052aec197 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153214 Aug 23 22:54:12.534772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1143/2309] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:12 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:12.723274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:12.723921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:12.725907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:12.730630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:12.731111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:12.731546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:12.732229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:12.732676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:12.733128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:12.862797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:12.871005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f97ba8f2-ebd8-4682-a96c-da4b7eabd5fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152443 Aug 23 22:54:12.871577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1167/2310] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:13.025876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:13.026421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:13.032501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.032983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.033557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:13.034322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.034775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.035202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:13.096320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:13.098660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:13.105226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-271899c4-df22-45aa-b356-320122c39151 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083354 Aug 23 22:54:13.114567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1144/2311] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:13.556081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:13.556681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:13.563642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.564127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.564566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:13.565287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.565744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.566170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:13.694556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:13.703438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a3b45dc-5822-4520-9bb0-d6b171d3212a tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150586 Aug 23 22:54:13.704222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1168/2312] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:13 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:13.891757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:13.893063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:13.901538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.902028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.902481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:13.903697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:13.904530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:13.905193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:14.036742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:14.045550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-857bddc2-d1df-4ce5-8a1f-3947d8e6c543 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157698 Aug 23 22:54:14.046145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1145/2313] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:14.126498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:14.127030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:14.133056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:14.133567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:14.134001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:14.134682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:14.135134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:14.135555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:14.199442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:14.208092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d8dd1500-41c1-469b-b4f4-7f9c21b79077 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085628 Aug 23 22:54:14.208654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1169/2314] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:14.725444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:14.726119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:14.732150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:14.732628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:14.733089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:14.734420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:14.734877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:14.735299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:14.863806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:14.871950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e7518ed1-5207-4530-a361-1601a2bf90f1 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.150500 Aug 23 22:54:14.872509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1146/2315] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:15.067482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:15.068001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:15.074571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.075041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.075468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:15.076135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.076578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.076989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:15.215474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:15.223819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f04f5bc-5cf2-40f2-bc49-49d67851417d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160255 Aug 23 22:54:15.224572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1170/2316] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:15.229571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:15.230184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:15.236973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.237486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.237915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:15.238729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.239179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.239600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:15.302311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:15.310729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2f91696a-0c40-4479-9be6-61330d553248 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085041 Aug 23 22:54:15.311277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1147/2317] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:15.959548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:15.960163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:15.966023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.966497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.966925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:15.967595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:15.968072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:15.968478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:16.098013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:16.106409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-75bc0cf7-4ed9-4b85-827f-0a1b03f90862 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.215313 Aug 23 22:54:16.106970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1171/2318] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:16.246542 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:16.247142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:16.254304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:16.254781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:16.255209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:16.255886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:16.256329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:16.256742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:16.331725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:16.332342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:16.338305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:16.338795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:16.339243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:16.339972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:16.340426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:16.340854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:16.389151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:16.397600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d8490e4b-9d07-47cd-a3fc-3f1c280445d6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154968 Aug 23 22:54:16.398209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1148/2319] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:16.403303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:16.411645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cc174147-36d4-41d9-ab29-16b5f3f40c58 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083905 Aug 23 22:54:16.412207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1172/2320] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:17.128271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:17.128916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:17.135100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.135581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.136016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.136698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.137243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.137666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.267509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:17.275789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3a3dfff0-f463-4e81-94b1-944e7c59b94b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151828 Aug 23 22:54:17.276352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1149/2321] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:17 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:17.419250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:17.419797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:17.426202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.426670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.427094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.427791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.428238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.428652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.433243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:17.433864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:17.440608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.441123 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.441565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.442248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:17.442702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:17.443129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:17.509834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:17.518912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-684984a3-44d5-4186-af87-e281360e7ac2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089478 Aug 23 22:54:17.519514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1150/2322] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:17.563164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:17.571615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7b94c61c-efcb-4b9c-a61f-f182676f9c14 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156532 Aug 23 22:54:17.572181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1173/2323] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:18.299273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:18.299922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:18.306377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.306861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.307301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.307987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.308439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.308862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.435869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:18.444087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-35820683-be90-4465-adb4-5a6f6fee2f25 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.149692 Aug 23 22:54:18.444654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1151/2324] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:18 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:18.540020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:18.540664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:18.547757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.548261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.548697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.549405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.549860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.550286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.594753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:18.595361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:18.601439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.601932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.602371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.603060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:18.603514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:18.603936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:18.612478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:18.622688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b210e832-e563-44e4-8b3d-72157901b319 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086497 Aug 23 22:54:18.635618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1174/2325] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:18.733457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:18.741645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2f8c6295-4a46-455f-8ad8-6a13be8f02d1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151460 Aug 23 22:54:18.742214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1152/2326] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:19.466046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:19.466673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:19.473694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.474229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.476017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.476017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.476017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.476307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.492100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:19.611027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:19.619231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-977f643a-2464-4f23-ac80-f91e1785e2a2 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157037 Aug 23 22:54:19.619809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1175/2327] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:19 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:19.650128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:19.650772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:19.657712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.658199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.658632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.659311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.659761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.660215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.725293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:19.733471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-08367ce9-61c0-4153-b5f9-0d85747265a1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087131 Aug 23 22:54:19.735001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1153/2328] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:19.762329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:19.762947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:19.769060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.769546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.769986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.770717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:19.771166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:19.771598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:19.901988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:19.910857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-13e0da7a-0217-42c2-83b3-93c1f11c3737 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152340 Aug 23 22:54:19.911431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1176/2329] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:20.641106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:20.641719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:20.647902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.648379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.648813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:20.649528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.649982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.650421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:20.755630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:20.756749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:20.763401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.763881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.764325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:20.765105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.765728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.766174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:20.785439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:20.794125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-daf497fb-5ba6-4315-a7e7-395cafaba9f8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157628 Aug 23 22:54:20.794708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1154/2330] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:20.831846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:20.840904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a9f3cbd-6f34-40b4-a783-2ea3a936f78b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089072 Aug 23 22:54:20.841563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1177/2331] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:20.934551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:20.935374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:20.942988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.943477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.943910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:20.944605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:20.945081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:20.945544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:21.094960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:21.103897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-413597ed-54ee-47e9-b85b-7c5d62f8b701 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.173260 Aug 23 22:54:21.104512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1155/2332] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:21.816084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:21.816617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:21.823291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:21.823788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:21.824226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:21.824917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:21.825400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:21.825823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:21.863330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:21.863965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:21.870978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:21.871473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:21.871914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:21.872619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:21.873101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:21.873532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:21.940350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:21.948973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a31975f-8212-4140-b731-ce30546db7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089348 Aug 23 22:54:21.949606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1156/2333] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:21.960907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:21.969741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e482c26-efb1-48d6-930c-f49bd65820bb tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157594 Aug 23 22:54:21.970307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1178/2334] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:22.128491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:22.129043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:22.135054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:22.135541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:22.135984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:22.136669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:22.137169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:22.137596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:22.271587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:22.275763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c994d76b-682f-4bfa-9506-5af2b6cb5c92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151392 Aug 23 22:54:22.276344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1157/2335] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:22.970319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:22.970997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:22.977499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:22.977980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:22.978416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:22.979102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:22.979550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:22.979978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:22.990854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:22.991475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:22.998012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:22.998506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:22.998944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:22.999638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:23.000292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:23.000719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:23.042860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:23.051796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-88ba9018-9977-4d6e-86aa-3e78cc677185 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085267 Aug 23 22:54:23.052597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1179/2336] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:23.132557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:23.142417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7659bfe9-b7d8-4f96-9a19-a6c2ea1b406e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155368 Aug 23 22:54:23.142999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1158/2337] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:22 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:23.298298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:23.298820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:23.304783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:23.305293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:23.305731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:23.306421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:23.306870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:23.307290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:23.433058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:23.441803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b446e795-cb04-4459-90ee-27bf019bddd6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.148078 Aug 23 22:54:23.442400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1180/2338] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:24.072508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:24.073140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:24.082163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.083044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.083860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.085158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.086019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.086837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.154824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:24.163787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-89a18b34-86d7-4934-a4aa-bdde0e9eed0f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.095087 Aug 23 22:54:24.164350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1159/2339] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:24 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:24.165684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:24.166663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:24.175153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.176031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.176833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.177834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.178249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.178695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.323486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:24.331915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d602f8e-8c48-4db8-b4fa-ab3a6b268752 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.170369 Aug 23 22:54:24.332510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1181/2340] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:24 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:24.463752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:24.464362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:24.471365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.471847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.472282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.472980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:24.473448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:24.473866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:24.606613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:24.614904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e1573f2e-5742-45e0-b8e8-8a435a546a0f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155164 Aug 23 22:54:24.615463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1160/2341] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:25.188537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:25.189204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:25.196046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.196530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.196965 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.197677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.198123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.198538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.265557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:25.277947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e3a6051c-10eb-41e6-8d59-6cbb935abb74 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094106 Aug 23 22:54:25.278522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1182/2342] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:25.354471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:25.355092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:25.362827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.363312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.363777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.364551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.365052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.365522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.381764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:25.494035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:25.502922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-18c073f4-1dbe-4388-872e-76f9728bb430 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152287 Aug 23 22:54:25.503492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1161/2343] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:25 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:25.635787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:25.636390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:25.642315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.642788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.643214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.643879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:25.644322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:25.644735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:25.771212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:25.781451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d2fd8fde-f245-4a8d-bad4-aa2433039952 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149288 Aug 23 22:54:25.782039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1183/2344] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:26.299629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:26.300264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:26.306245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.306717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.307143 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.307821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.308265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.308680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.375476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:26.383878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-98c9e5bc-aee4-4910-8a41-c59482934c94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088282 Aug 23 22:54:26.384453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1162/2345] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:26.524803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:26.525562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:26.532317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.532801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.533274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.533982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.534405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.534821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.668364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:26.677120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d995b1b-a899-44a8-986a-5271d761dd55 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156082 Aug 23 22:54:26.677736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1184/2346] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:26.803041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:26.803601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:26.809564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.810048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.810484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.811218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:26.811675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:26.812688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:26.942073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:26.950282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7efc2664-a35d-4a74-b021-a058e59e0dad tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151223 Aug 23 22:54:26.950846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1163/2347] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:27.405310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:27.406143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:27.412014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.412489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.412916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:27.413617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.414065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.414535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:27.474834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:27.482850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6b035201-7603-4d8f-b5d8-4ab9dd484b02 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.081425 Aug 23 22:54:27.483644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1185/2348] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:27.698770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:27.699379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:27.706040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.706553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.706991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:27.707685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.708136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.708560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:27.838388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:27.847099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f7d91b1e-352d-4365-a368-81548e6c81bd tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152172 Aug 23 22:54:27.847673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1164/2349] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:27.972529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:27.973100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:27.979542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.980045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.980463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:27.981217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:27.981673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:27.982129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:28.110463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:28.118824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-850d07b2-1f9c-4ba9-ae22-7ec6c340f8f5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151021 Aug 23 22:54:28.119384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1186/2350] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:28.504368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:28.504894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:28.510960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:28.511438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:28.511870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:28.512544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:28.512984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:28.513470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:28.578259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:28.586505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92b4054e-d53c-4eba-8358-c84e2c29c2c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086104 Aug 23 22:54:28.587069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1165/2351] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:28.869042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:28.869565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:28.876166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:28.876641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:28.877097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:28.877773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:28.878580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:28.879258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:29.141606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:29.142226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:29.148916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:29.149434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:29.149867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:29.150564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:29.151018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:29.151439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:29.240188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:29.248597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d2328214-f0ae-4b81-add0-6b416e59f5f5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.383477 Aug 23 22:54:29.249198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1187/2352] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:28 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:29.286819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:29.295379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2ab8bb36-95b5-4a7d-8ed1-5d22cc706eb2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158347 Aug 23 22:54:29.296163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1166/2353] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:29.607029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:29.607629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:29.613688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:29.614166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:29.614594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:29.615328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:29.615772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:29.616187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:29.677676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:29.685928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0ed5f506-3492-4f97-8fe5-3b15cc5ff70b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082745 Aug 23 22:54:29.686492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1188/2354] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:30.269671 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:30.270212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:30.276534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.277029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.277579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.278250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.278693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.279105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.321369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:30.321963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:30.328198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.328688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.329159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.329857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.330306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.330729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.409654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:30.418315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cdf57198-d785-46ed-a42e-5c98aeed30c7 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152534 Aug 23 22:54:30.418893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1167/2355] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:30 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:30.468168 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:30.476961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f18f862d-5300-421a-b9d4-1949a0ff6c2c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159369 Aug 23 22:54:30.477591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1189/2356] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:30.707893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:30.708539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:30.715298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.715782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.716223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.716925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:30.717404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:30.717829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:30.783349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:30.792019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2a8d7036-30a5-4915-af83-e14135048bdb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088119 Aug 23 22:54:30.792587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1168/2357] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:31.444876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:31.445590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:31.452182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.452853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.453568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.454259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.454710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.455132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.500685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:31.501442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:31.508362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.508859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.509319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.510028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.510481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.510901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.594803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:31.603501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-afcb2f33-d4d0-4a6e-836b-cde10945f59e tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.162817 Aug 23 22:54:31.604056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1190/2358] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:31 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:31.643993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:31.652494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-de539e6d-ffc5-4db7-9d2b-6f64c52a03f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156667 Aug 23 22:54:31.653083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1169/2359] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:31.813947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:31.814464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:31.820511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.820991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.821467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.822152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:31.822602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:31.823053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:31.883509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:31.892463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-da217808-4c66-40d2-b130-c07ff95d0014 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083036 Aug 23 22:54:31.893053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1191/2360] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:32.625132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:32.625745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:32.632197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.632682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.633166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.633860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.634317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.634740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.674462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:32.675093 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:32.681620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.682095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.682521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.683200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.683644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.684060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.686775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:32.767817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:32.781391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a53dce88-d015-4777-b754-d77e9a002bab tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159167 Aug 23 22:54:32.782436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1170/2361] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:32.832985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:32.841455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-83d29b6c-db4b-4f4c-aeb8-5b8ba718e9be tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.170870 Aug 23 22:54:32.842034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1192/2362] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:32.912928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:32.913573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:32.919863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.920351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.920787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.921549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:32.922087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:32.922514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:32.987482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:32.995740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-34c99315-3bf8-4413-bc85-21b82a3b2b78 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086602 Aug 23 22:54:32.996322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1171/2363] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:33.816702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:33.817504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:33.824237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:33.824635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:33.825101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:33.825800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:33.826276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:33.826694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:33.867892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:33.868976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:33.879813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:33.880640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:33.881400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:33.882640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:33.883418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:33.884130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:33.970375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:33.978845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a06309e5-14ce-4ec2-8c8f-9454f19012d0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166173 Aug 23 22:54:33.979413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1193/2364] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:34.017271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:34.018049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:34.024000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:34.024479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:34.024909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:34.025625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:34.026078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:34.026493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:34.033948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:34.042451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9cbb1d67-9e75-49ab-b721-9884003a47d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.181489 Aug 23 22:54:34.043022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1172/2365] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:34.091148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:34.100708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8590b5c8-72af-4a73-aa26-9f9e8e22aec5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087292 Aug 23 22:54:34.101322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1194/2366] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:35.001867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:35.002862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:35.009833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.010378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.010947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.011649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.012115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.012527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.064805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:35.065465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:35.072343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.072904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.073377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.074077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.074531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.074960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.208546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:35.222522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:35.222724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-082d6b45-9b64-492a-a8ca-d973add2b9c9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.219625 Aug 23 22:54:35.222724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1173/2367] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:35.225191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:35.225932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:35.228853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f5d3898a-f435-4297-98a6-6b62bbb35079 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.168287 Aug 23 22:54:35.229656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1195/2368] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:35.232129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.232746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.233130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.234566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:35.235035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:35.235465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:35.303107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:35.311384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0722767c-e9e2-4e84-abc0-327d6b861894 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091422 Aug 23 22:54:35.312741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1174/2369] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:35.380212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:54:35.380477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:54:36.243207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:36.243802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:36.250800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.251010 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:36.251440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.251553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:36.251711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.252401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.252856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.253324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.257743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.258238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.258705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.259431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.259890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.260314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.388909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:36.396637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:36.397919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6f5369ab-8186-42ca-8746-62b5f4280214 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158516 Aug 23 22:54:36.398718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1196/2370] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:36 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:36.408437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f6abb7ab-e9da-4597-b594-a96afe60e54c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161212 Aug 23 22:54:36.409517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1175/2371] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:36.414304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:36.414933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:36.422438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.422996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.423439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.424147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:36.424600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:36.425102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:36.488461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:36.496692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c56ea69c-cb82-4fd8-b49a-4cc62c406192 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093179 Aug 23 22:54:36.497297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1197/2372] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:37.072154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:54:37.072411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:54:37.422075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:37.422724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:37.430219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.430717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.431149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.431844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.432018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:37.432570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.432730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:37.432886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.439709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.440194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.440624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.441344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.441786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.442200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.591126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:37.591374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:37.598404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bbf62665-ed04-467e-93ce-7545e7b8678b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.170244 Aug 23 22:54:37.598640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dd7d85b6-4cd5-4c9c-a5dc-90840f29fe2f tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.180936 Aug 23 22:54:37.598996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1176/2374] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:37 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:37.599173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1198/2374] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:37.606728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:37.607440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:37.615507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.616020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.616503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.617231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:37.617670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:37.618096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:37.685287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:37.695096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dff331ca-fbd5-4354-be80-9de16ffc0927 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092186 Aug 23 22:54:37.695682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1199/2375] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:38.622233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:38.622878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:38.625515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:38.626141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:38.630281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.630766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.631204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.631897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.632341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.632598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.632787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.633125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.633568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.634253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.634713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.635136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.781945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:38.791717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:38.794146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6d2efc5a-8386-4ee3-8cab-5e3c5508895c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.173192 Aug 23 22:54:38.795211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1177/2376] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:38.800301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:38.800900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:38.802481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e16e7ab0-68d0-405d-8903-6caec5346329 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.185781 Aug 23 22:54:38.803253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1200/2377] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:38 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:38.806541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=80 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:38.808017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.808736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.809469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.810386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:38.811037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:38.812378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:38.815562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:38.880764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:38.889057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ec66ad8d-9104-4cc4-b373-9bc7afbd5338 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092326 Aug 23 22:54:38.889686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1178/2378] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:39.818366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:39.818928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:39.825139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:39.825719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:39.825933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:39.826245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:39.826681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:39.828105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:39.828563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:39.829040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:39.833332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:39.833825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:39.834264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:39.834968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:39.835419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:39.835876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:39.979956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:39.982060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:39.989724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0fb747b-9b5d-437f-9fe0-4c483cf03b36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.175272 Aug 23 22:54:40.000061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1201/2379] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:40.000278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b3a1e3b6-7b12-4fca-912e-7d457841c39d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.170356 Aug 23 22:54:40.000278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1179/2380] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:39 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:40.000489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:40.000489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:40.003711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:40.004202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:40.004808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:40.005531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:40.005985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:40.006408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:40.070380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:40.083105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93830bf7-a6ce-4618-8ecc-fc3788f681a2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090942 Aug 23 22:54:40.083712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1202/2381] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:41.012726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:41.013478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:41.016174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:41.016792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:41.020626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.021139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.021571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.022261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.022709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.023124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.023299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.023757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.024185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.024869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.025361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.025781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.164658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:41.174893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:41.176418 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd498c09-906e-45d5-93ec-899981dfc386 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166178 Aug 23 22:54:41.177109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1203/2382] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:41 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:41.182096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:41.182706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:41.188950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.189408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7c43df6b-e80b-4086-adde-f374b06e5235 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.180449 Aug 23 22:54:41.189628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.189961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.190657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:41.191110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:41.191261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1180/2383] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:41.191530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:41.253643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:41.261846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9ff030aa-f244-4bd4-b70c-e2a4e6845955 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083759 Aug 23 22:54:41.262414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1204/2384] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:42.199168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:42.199168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:42.205725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.206216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.206650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.208864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.208864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.208864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.216224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:42.216904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:42.224381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.225074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.225515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.226255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.226729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.227151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.337761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:42.346568 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-378c6185-398a-4e71-b0bf-36e1d0915be5 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152070 Aug 23 22:54:42.349481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1181/2385] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:42 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:42.351544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:42.352145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:42.358082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.359337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.359780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.360474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:42.360933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:42.361387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:42.369295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:42.377654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-386d014e-2a0f-461b-aaaf-dc0d12307e7d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167416 Aug 23 22:54:42.378235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1205/2386] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:42.431721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:42.440376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-78360f0d-1ae9-4d8f-a104-0c26c906b162 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092232 Aug 23 22:54:42.440886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1182/2387] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:43.378646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:43.379244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:43.381728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:43.386482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.393377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.393377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.393377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.393377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.393833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.399630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:43.400371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:43.407379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.407857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.408291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.408977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.409451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.409884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.524123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:43.536005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7cf7cb4-3086-4e0a-b0e5-4b86de2b4070 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160256 Aug 23 22:54:43.536005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1206/2388] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:43 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:43.541062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:43.541062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:43.546891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:43.552130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.552668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.553141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.553867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:43.554314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1cea58a1-67ea-435c-a0bb-c07a395bb3d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158433 Aug 23 22:54:43.554439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:43.554735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:43.557074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1183/2389] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:43.624318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:43.634337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ac4572d1-5d31-40a3-9d92-41d1d6f91cce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.097467 Aug 23 22:54:43.634826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1207/2390] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:44.558172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:44.558757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:44.566286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.566770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.567206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.567893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.568345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.568763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.578409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:44.579112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:44.585753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.586248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.586685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.587384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.587835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.588259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.719392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:44.727492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:44.727726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3a8f3993-d69f-4f00-93c9-5bc836511593 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.173383 Aug 23 22:54:44.728312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1184/2391] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:44 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:44.729741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:44.732727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:44.735484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:44.740113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.740596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.740847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6ee54178-615c-442b-a067-45e60936a84a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167003 Aug 23 22:54:44.741087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.741802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1208/2392] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:44.741954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:44.742166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:44.742579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:44.809372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:44.818240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a0b2e17d-e851-4bfe-b78f-8b5fefd2145e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088948 Aug 23 22:54:44.818797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1185/2393] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:45.761058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:45.761823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:45.763351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:45.764009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:45.770417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.770910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.771347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.771502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.771889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.772032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.772324 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.772476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.772900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.773078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.773538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.773987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.910714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:45.918711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:45.919474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a122926c-e3a6-43fe-baf0-38940a50c1d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159819 Aug 23 22:54:45.920056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1186/2394] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:45.925090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:45.925683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:45.927579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-62f7d6f2-e441-4c5e-9f5a-537088b16032 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.170743 Aug 23 22:54:45.928351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1209/2395] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:45 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:45.931793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.932386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.932844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.933566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:45.935480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:45.935480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:45.998132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:46.007688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f7f4a641-edb5-46b5-b456-3b34f9449078 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085975 Aug 23 22:54:46.007983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1187/2396] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:46.940747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:46.941305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:46.948088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:46.948580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:46.949038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:46.949737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:46.949864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:46.950312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:46.950414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:46.950594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:46.957738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:46.958216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:46.958646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:46.959334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:46.959794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:46.960205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:47.101121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:47.104241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:47.111583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1bf39ea9-8e7b-49cc-b731-374ef1cbdb82 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.174728 Aug 23 22:54:47.112172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1210/2397] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:47.113578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a34d9e15-1814-4aae-8950-6f9121d471a9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.168045 Aug 23 22:54:47.114445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1188/2398] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:46 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:47.117055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:47.117669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:47.124044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:47.124545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:47.125465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:47.126171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:47.126628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:47.127056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:47.191327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:47.200025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f26f8f1-02a9-4f66-a5c7-6f2cb405c31c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086888 Aug 23 22:54:47.200604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1211/2399] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:48.135806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:48.136456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:48.136870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:48.136987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:48.143125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.143620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.144060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.144176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.144608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.144760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.145067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.145233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.145659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.145767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.146202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.146625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.289176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:48.292856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:48.298259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e14e949c-9240-482c-b858-cf01dba8ad43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.166252 Aug 23 22:54:48.298846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1189/2400] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:48.303506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:48.304165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:48.310333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.311337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.312118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.312482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:48.312955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:48.313404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:48.313538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ad5ea19d-70ca-4aea-809a-dbffd6965e70 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.181163 Aug 23 22:54:48.314120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1212/2401] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:48 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:48.381995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:48.391204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d4f5c4a5-fb17-43c1-be7c-76a4cb1e7edf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091286 Aug 23 22:54:48.391705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1190/2402] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:49.321384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:49.321972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:49.328954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.329458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.329888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.330565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.331006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.331425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.335340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:49.335999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:49.342119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.342615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.343051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.344352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.344812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.345262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.467753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:49.477069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-83a70f07-3e8d-4670-9b4a-8ff1c020861c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159639 Aug 23 22:54:49.477660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1213/2403] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:49.481707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:49.482960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:49.485048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:49.490333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.490823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.491256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.491950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:49.492402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:49.492821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:49.496713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-065b8f6d-1e46-494a-8c9c-85fe08f06b65 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165056 Aug 23 22:54:49.497427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1191/2404] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:49 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:49.556818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:49.566019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-513cfd50-7512-4ec6-b24c-e30b0faf97f8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087409 Aug 23 22:54:49.566593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1214/2405] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:50.498730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:50.499538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:50.506453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.507526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.507526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.510087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.510087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.510087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.520059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:50.521561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:50.531795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.532283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.532730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.533479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.533930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.534376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.661793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:50.671184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb898b74-de88-4974-85a0-45973be709e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.176284 Aug 23 22:54:50.672058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1192/2406] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:50.676712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:50.677417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:50.678297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:50.683964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.684452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.684882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.685593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:50.686041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:50.686461 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:50.686948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-783ce4e3-aac2-4ffd-875b-0812e95ef4f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.171448 Aug 23 22:54:50.688245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1215/2407] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:50 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:50.752295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:50.760582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-30668716-182f-4e21-beac-00252ed978da tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087584 Aug 23 22:54:50.761172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1193/2408] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:51.694193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:51.694784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:51.701690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.702180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.702691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.703395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.704063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.704497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.709977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:51.710650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:51.717573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.718071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.718710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.719270 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.719759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.720186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.856432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:51.864947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:51.865400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f11b728-b498-43d2-a929-b5e75c7369da tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.175114 Aug 23 22:54:51.865972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1216/2409] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:51.867418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:51.870463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:51.871060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:51.874663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bf751a3a-333f-46b6-853a-ebe8544b84fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.168381 Aug 23 22:54:51.875856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1194/2410] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:51 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:51.883038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.883038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.883038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.883038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:51.883532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:51.883532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:51.959744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:51.968654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae449190-799b-4224-ab78-d2189183817c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.101161 Aug 23 22:54:51.969278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1217/2411] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:52.888509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:52.889107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:52.896245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:52.896744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:52.897204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:52.897894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:52.898350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:52.898771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:52.914201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:52.914814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:52.921791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:52.922334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:52.922774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:52.923476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:52.923927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:52.924349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:53.028507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:53.037107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-53f92740-6f63-43cf-a2ed-fb4ef6ea9739 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153417 Aug 23 22:54:53.037661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1195/2412] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:53.042549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:53.043541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:53.049580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:53.050059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:53.050486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:53.051165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:53.051613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:53.052026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:53.058815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:53.067386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26ade7b4-7839-430b-8431-41fbf77268f9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157040 Aug 23 22:54:53.067958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1218/2413] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:52 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:53.119357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:53.128320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-53807fa7-3c69-47f6-87e0-03f43f525b89 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089687 Aug 23 22:54:53.128863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1196/2414] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:54.059207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:54.059845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:54.067124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.067602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.068036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.068719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.069275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.069698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.088579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:54.089202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:54.095569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.096044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.096472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.097184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.097631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.098044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.210366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:54.219470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-79dd3482-5926-4fae-b00a-bacd83532022 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164083 Aug 23 22:54:54.220045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1219/2415] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:54.224768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:54.225541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:54.231383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:54.233639 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.234252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.234713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.235447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:54.235952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:54.236527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:54.239594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-10ee58eb-c159-4cf9-9b0d-e61abe4f3aef tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.154856 Aug 23 22:54:54.240164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1197/2416] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:54 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:54.302388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:54.310710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0b730469-660e-4cf6-b2ae-8cc98ad1d9c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089650 Aug 23 22:54:54.311222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1220/2417] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:55.240875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:55.241558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:55.248108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.248595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.249057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.251522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.251981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.252412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.263712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:55.264344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:55.274032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.274519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.274951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.275645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.276092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.276512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.397038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:55.406096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b79a2371-db34-41d9-906e-22fd844cbf2f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.168570 Aug 23 22:54:55.406720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1198/2418] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:55.411228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:55.411833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:55.419698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:55.423128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.423746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.424215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.424923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:55.425418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:55.425905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:55.428559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6aae5fa1-2085-4c63-ac79-34fba717a550 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.168642 Aug 23 22:54:55.429183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1221/2419] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:55 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:55.493589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:55.502403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2b05fa14-3835-4987-8e58-f406682cbef2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094682 Aug 23 22:54:55.502975 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1199/2420] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:56.428560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:56.429232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:56.435667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.436154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.436644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.437674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.438139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.438560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.450858 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:56.451871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:56.458735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.459224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.459696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.460459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.460919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.461392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.577834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:56.586453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4ad5f05d-7867-4446-a2ae-c8c9b2269874 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161728 Aug 23 22:54:56.587034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1222/2421] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:56.591641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:56.592230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:56.599087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.599559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.599992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.600675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:56.601350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:56.601764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:56.607035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:56.616310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dc7e698d-d988-4f39-8e33-7c0bb8dd2b6b tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.169284 Aug 23 22:54:56.616885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1200/2422] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:56 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:56.670292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:56.678950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26a2b60b-8ba9-4042-8dcb-f0aba95884c6 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090827 Aug 23 22:54:56.679563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1223/2423] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:57.607647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:57.608263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:57.615432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.615921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.616358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.617093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.617552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.617976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.643293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:57.647022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:57.650667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.651153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.651587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.652278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.652968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.653416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.759495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:57.770987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cde65299-b5be-460a-a84f-8bb18d1b26ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164495 Aug 23 22:54:57.770987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1201/2424] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:57.773261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:57.773871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:57.781794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.782597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.783805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.784556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:57.785043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:57.785482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:57.802356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:57.810617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-602f07b2-1731-416e-9b70-58b9fec9acda tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.171219 Aug 23 22:54:57.811105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1224/2425] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:57 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:57.854449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:57.863701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57bd7a9b-dd14-4086-9402-af4bd86c3daf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093950 Aug 23 22:54:57.864274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1202/2426] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:58.790122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:58.790730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:58.797946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.798454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.798891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.799672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.800119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.800537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.818879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:54:58.832642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:58.833290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:58.840156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.840676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.841139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.841832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.842281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.842707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.945979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:58.954468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2c584dfe-976f-446c-88ca-ac93c55df305 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.168405 Aug 23 22:54:58.955456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1225/2427] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:58.959911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:58.960516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:58.966450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.966936 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.967572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.968304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:58.969035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:58.969390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:58.982188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:58.991316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c452e43d-1b50-4d73-ad3c-e009e974c45d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163180 Aug 23 22:54:58.992015 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1203/2428] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:58 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:54:59.041617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:54:59.050751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0be836be-0894-474f-9b48-78a2c89fbd93 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094307 Aug 23 22:54:59.051343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1226/2429] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:54:59.975833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:54:59.976523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:54:59.983157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:59.984173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:59.984614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:54:59.985379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:54:59.985840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:54:59.986263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:00.013872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:00.014519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:00.021526 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:00.022016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:00.022452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:00.023147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:00.023601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:00.024026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:00.124291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:00.133080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d312f051-70a7-42a9-bb92-99537dc91bf4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161056 Aug 23 22:55:00.133664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1204/2430] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:54:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:00.138307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:00.138927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:00.145358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:00.145849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:00.146576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:00.146976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:00.147427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:00.147846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:00.162759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:00.174272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1fb375d9-584f-45b5-a59b-79a478e49655 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.164160 Aug 23 22:55:00.174869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1227/2431] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:00 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:00.218989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:00.227596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-07092744-0f62-436c-83ca-601b29222cc1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092877 Aug 23 22:55:00.228107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1205/2432] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:01.162019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:01.162696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:01.171654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.172134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.172600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.173443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.173947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.174393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.195569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:01.196286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:01.203496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.203919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.204412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.205164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.205615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.206028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.316094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:01.324251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9251e148-71ae-48f4-94be-78b0890b2b7f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.169746 Aug 23 22:55:01.324823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1228/2433] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:01.329668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:01.330277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:01.339070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:01.346916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.347628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.347844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.348401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:01.348857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:01.349499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:01.350178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b57a4839-143a-443c-b509-8d74c55d5e9d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158375 Aug 23 22:55:01.350765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1206/2434] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:01 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:01.423450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:01.432116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c71921dd-d0b1-43ed-8000-6b911e0d3d70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.106306 Aug 23 22:55:01.432679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1229/2435] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:02.351265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:02.351863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:02.359703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.360186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.360619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.361334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.361787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.362207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.372030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:02.372653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:02.380322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.380819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.381293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.381996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.382449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.382873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.494673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:02.503563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d5003e20-f2b4-4e78-aa79-34ba344e76e8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156207 Aug 23 22:55:02.504120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1207/2436] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:02.508508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:02.509130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:02.515505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.515992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.516420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.517129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:02.517578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:02.517993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:02.519590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:02.527934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae5023bd-f40a-4c33-9d65-a323ae57f558 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159862 Aug 23 22:55:02.528504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1230/2437] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:02 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:02.583734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:02.591865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-36b37103-6705-44e7-a259-2f1e88a62df9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086799 Aug 23 22:55:02.592445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1208/2438] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:03.526148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:03.526742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:03.534096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.534573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.535006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.535680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.536129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.536545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.550095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:03.550745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:03.557854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.557854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.558295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.558973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.559416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.559830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.667968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:03.676941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7cfaec7-a1ea-48da-8a8e-93dd66cc2a62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154586 Aug 23 22:55:03.677534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1231/2439] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:03.681907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:03.682572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:03.689266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.689753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.690204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.690864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:03.691294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:03.691709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:03.693978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:03.702426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d2ec58cb-3af1-4bfa-b3df-df7943e1cc39 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.156292 Aug 23 22:55:03.702998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1209/2440] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:03 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:03.758204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:03.766673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-82805cbb-5d5c-40ae-ba52-4094c142b6a3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088119 Aug 23 22:55:03.767250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1232/2441] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:04.698622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:04.699267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:04.705821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.706306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.706741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.707432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.707886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.708310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.723926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:04.724569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:04.730843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.731323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.731754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.732444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.732893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.734053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.838016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:04.847055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5c4b477b-003d-4700-8bcb-0dfef1c38a81 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152289 Aug 23 22:55:04.847628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1210/2442] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:04.852174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:04.852783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:04.859305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.859847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.860290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.861004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:04.862291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:04.862766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:04.864201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:04.872427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-673ec1af-834f-48ab-9c19-3ccad9830e10 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.152281 Aug 23 22:55:04.873000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1233/2443] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:04 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:04.878731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:04.929659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:04.937931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3d1c1885-34b2-4c57-af43-5cd974e93c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089339 Aug 23 22:55:04.938493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1211/2444] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:05.869308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:05.869871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:05.877399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:05.877889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:05.878321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:05.879021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:05.879468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:05.879887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:05.894204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:05.895540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:05.901656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:05.902139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:05.902572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:05.903261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:05.903707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:05.904121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:06.020545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:06.028994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-07ed8d3d-08bc-496d-a8cf-f40d1975db4c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.163608 Aug 23 22:55:06.029825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1234/2445] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:06.034825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:06.035434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:06.041527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:06.042015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:06.042501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:06.043426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:06.044457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:06.044457 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:06.046782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:06.055587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6be00544-103f-4610-809d-2ff17ea14381 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.165612 Aug 23 22:55:06.058827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1212/2446] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:05 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:06.111041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:06.119292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6795b2b0-3c0c-48d1-b33f-74b3a9d7f7c8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088094 Aug 23 22:55:06.119922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1235/2447] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:07.051133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:07.051802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:07.058207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.058695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.059142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.059828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.060280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.060717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.078450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:07.079058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:07.084943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.085466 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.085902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.086614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.087068 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.087487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.190168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:07.198856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1493c75e-d7ae-4dd6-aae1-7e8c6204ad73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151583 Aug 23 22:55:07.199427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1213/2448] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:07.215095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:07.215817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:07.219251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:07.222236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.222719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.223174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.223857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:07.224306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:07.224721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:07.227572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5b459ff1-6b66-4b2e-8961-1c530edb661d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.153692 Aug 23 22:55:07.228140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1236/2449] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:07 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:07.287985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:07.296516 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fcf3788a-e3cf-44b4-bfcc-e950facfd692 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.096036 Aug 23 22:55:07.297092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1214/2450] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:08.220189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:08.220790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:08.227537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.228011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.228438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.229149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.229595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.230013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.248197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:08.249494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:08.256281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.256765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.257267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.258141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.258627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.259248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.372158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:08.380956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e50ac96-3c93-40c6-874f-b3c193a646c9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164675 Aug 23 22:55:08.389108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1237/2451] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:08.389108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:08.389108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:08.393462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.393952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.394416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.395110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:08.395554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:08.395970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:08.466411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:08.475775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8bc4bf3e-0f30-46ba-83a4-a12b3467f698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093114 Aug 23 22:55:08.476363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1238/2452] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:08.644513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:08.652850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f5968a3d-6969-4843-bc54-04dbef86f7fe tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.408793 Aug 23 22:55:08.653441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1215/2453] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:08 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:09.402762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:09.403380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:09.410472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.410969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.411408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.412094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.412551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.412977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.497665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:09.498314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:09.501339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=76 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:09.506053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.506546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.506982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.507678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.508128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.508557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.543157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:09.553628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4551614f-c23b-48eb-a6c2-7dc0f9fb864c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154064 Aug 23 22:55:09.553628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1239/2454] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:09.574266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:09.582731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-74e94fe6-63db-4806-8bd2-d6c0651dadd7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088846 Aug 23 22:55:09.583298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1216/2455] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:09.675310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:09.676197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:09.682575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.683051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.683487 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.684158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:09.684601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:09.685032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:09.812544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:09.821483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8d48f26d-c02d-4f86-8953-577f633372a8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.149397 Aug 23 22:55:09.821483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1240/2456] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:09 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:10.575830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:10.576448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:10.583263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.583740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.584174 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.584983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.585465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.585892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.604919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:10.605629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:10.613000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.613596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.614063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.614832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.615279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.615699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.686262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:10.695039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-92287dcc-3630-443d-90b9-f749162caf37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094772 Aug 23 22:55:10.695626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1241/2457] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:10.735098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:10.743788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a31ef7bb-6224-4e30-a0e1-6391fcf3a782 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.171839 Aug 23 22:55:10.744367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1217/2458] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:10.842883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:10.843818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:10.849867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.850350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.850841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.851817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:10.852276 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:10.852702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:10.855420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:10.989939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:10.998091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a8c84c8d-843e-4216-946b-c0b93c9186c0 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159679 Aug 23 22:55:10.999225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1242/2459] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:10 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:11.715871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:11.716517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:11.723908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:11.724396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:11.724846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:11.725590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:11.726068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:11.726500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:11.765996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:11.766763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:11.774602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:11.775996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:11.776411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:11.777139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:11.777587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:11.778842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:11.794804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:11.803443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e3687450-f032-45e7-a569-a0590b3be3f1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091452 Aug 23 22:55:11.804521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1218/2460] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:11.921813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:11.931827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c01cc500-30f1-4ce2-94ed-e40be37e4b1a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.170310 Aug 23 22:55:11.931827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1243/2461] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:12.020103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:12.020717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:12.026705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.027187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.027618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:12.028302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.028751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.029213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:12.165338 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:12.174165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c7df75ad-496c-433e-936b-82db87c8af91 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157923 Aug 23 22:55:12.174742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1219/2462] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:12 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:12.827679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:12.828250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:12.834886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.835367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.835807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:12.836504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.836956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.837408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:12.906398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:12.914948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a89f5a24-d5e9-4516-a9d3-1440c3ef54ee tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093531 Aug 23 22:55:12.915517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1244/2463] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:12.952762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:12.953407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:12.960048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.960541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.960992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:12.961700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:12.962160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:12.962586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:13.096074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:13.104406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-abbc891d-a0c8-4ce0-9bb8-53e3ea5c4bef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155417 Aug 23 22:55:13.104968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1220/2464] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:13.194600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:13.195237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:13.201153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:13.201695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:13.202122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:13.202823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:13.203250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:13.203661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:13.334112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:13.342911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-86543030-5adb-47b1-b0cd-4182741816de tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.151580 Aug 23 22:55:13.343893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1245/2465] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:13 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:13.936371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:13.937023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:13.943198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:13.943683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:13.944120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:13.944808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:13.945287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:13.945709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:14.010274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:14.019207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a368c54d-bdd1-447e-8998-e3496e930710 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087219 Aug 23 22:55:14.019779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1221/2466] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:14.127836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:14.128402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:14.130889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=80 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:14.135803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:14.136285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:14.136729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:14.137447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:14.137900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:14.138319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:14.272497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:14.281381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e039162f-e901-4543-8a2b-bb08eda64d38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158442 Aug 23 22:55:14.281987 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1246/2467] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:14.364284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:14.364889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:14.370824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:14.371301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:14.371727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:14.372409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:14.372861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:14.373933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:14.518084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:14.521144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9ddc067-f8e7-415c-b1e9-2e617eeafbad tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.160583 Aug 23 22:55:14.521771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1222/2468] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:14 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:15.040044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:15.040668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:15.047559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.048051 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.048493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.049229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.049685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.050111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.118972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:15.128350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4a24c1e4-8689-47c1-89cd-3e7937b1b3c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092436 Aug 23 22:55:15.129787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1247/2469] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:15.303647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:15.304184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:15.310654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.311185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.311662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.312353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.312802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.313426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.452748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:15.461692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45bb5c97-d946-4ed4-abca-39688a432868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162030 Aug 23 22:55:15.462260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1223/2470] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:15.542887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:15.543518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:15.550150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.550637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.551070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.551762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:15.552208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:15.552622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:15.685333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:15.694378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d58ecbcc-3b9b-49aa-827d-fccdb2602ae9 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.155591 Aug 23 22:55:15.694959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1248/2471] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:15 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:16.149817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:16.150430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:16.156464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.156949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.157413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.158108 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.158557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.158976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.227051 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:16.236646 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-df85158e-5978-4fc4-9c02-ea55e55139db tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090657 Aug 23 22:55:16.237257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1224/2472] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:16.483337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:16.483928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:16.491476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.491972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.492405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.493150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.493604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.494022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.633464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:16.644507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4c9f65cf-d187-43d2-b8a6-ba6562444408 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.165084 Aug 23 22:55:16.645116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1249/2473] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:16.715832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:16.716660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:16.723879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.724372 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.724817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.725632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:16.726114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:16.726539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:16.963900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:16.979013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d1f9c21c-1867-446d-b62f-d0081c428cc3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.267092 Aug 23 22:55:16.979830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1225/2474] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:16 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:17.258040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:17.258619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:17.264590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:17.265722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:17.266143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:17.266831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:17.267274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:17.267696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:17.337344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:17.346104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f966b58c-38fc-48df-a756-8eba732c5e97 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091879 Aug 23 22:55:17.346699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1250/2475] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:17.666996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:17.667604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:17.674998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:17.675534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:17.675922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:17.676616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:17.677089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:17.677512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:17.818882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:17.827304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bb653bb4-f611-4dfc-ae1a-5ae4dbbc5cf0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164361 Aug 23 22:55:17.827889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1226/2476] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:18.000208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:18.000814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:18.007424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.007902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.008328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.009029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.009476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.009887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.146622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:18.155616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0211a384-41e6-4f68-8eb1-4ca0318e60b4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159302 Aug 23 22:55:18.156297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1251/2477] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:17 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:18.367477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:18.368001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:18.374784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.375322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.375751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.376427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.376872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.377311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.443088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:18.451413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f780c81a-0c3a-46de-a420-b8b63d3ed419 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087889 Aug 23 22:55:18.451984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1227/2478] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:18.849578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:18.850210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:18.856305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.856793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.857250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.857938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:18.858383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:18.858797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:18.990847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:18.999275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-325c8930-6fb5-4703-9065-1663267cb24a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153688 Aug 23 22:55:18.999916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1252/2479] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:19.177075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:19.177682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:19.184303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:19.184794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:19.185266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:19.185960 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:19.186978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:19.187569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:19.190391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:19.323547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:19.337153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-48959591-57c6-4fcc-96f5-f5ea8dbea0e6 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.163823 Aug 23 22:55:19.337743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1228/2480] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:19 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:19.472318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:19.472955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:19.484816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:19.485344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:19.485787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:19.486498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:19.486955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:19.487382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:19.556045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:19.565537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-47ad9d00-b0be-4936-8c23-a67a6a9c7b72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.097021 Aug 23 22:55:19.566118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1253/2481] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:20.020100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:20.020705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:20.026757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.027234 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.027664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.028350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.028794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.029246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.163876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:20.172850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d18a15b9-9e32-489f-9173-2596760ccd65 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156627 Aug 23 22:55:20.173441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1229/2482] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:20.360165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:20.360693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:20.366784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.367273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.367705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.368415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.368848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.369293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.506350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:20.515996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bdd4e081-4b83-4707-9632-eeefcb3237a3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159621 Aug 23 22:55:20.516650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1254/2483] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:20 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:20.588109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:20.588927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:20.596120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.596606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.597061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.597967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:20.598426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:20.598860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:20.667129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:20.675533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-600df63f-38e7-4526-a1b5-67be4fa7024a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092230 Aug 23 22:55:20.676105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1230/2484] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:21.198317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:21.198930 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:21.207296 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.208034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.208701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.209848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.210335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.210766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.345450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:21.354462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-312d11e3-5b34-48c2-b14f-46749392b377 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159566 Aug 23 22:55:21.354462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1255/2485] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:21.540976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:21.541540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:21.548463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.548949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.549420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.550109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.550556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.551008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.684711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:21.693782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7029acbe-6504-4b81-87bf-dbebd10ca932 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159385 Aug 23 22:55:21.694366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1231/2486] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:21 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:21.696863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:21.697508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:21.704641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.705166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.705608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.706307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:21.706769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:21.707195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:21.774327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:21.783367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4741446f-9633-470d-a626-e1a0ff6ad1e9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090376 Aug 23 22:55:21.783952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1256/2487] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:22.377526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:22.378140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:22.384207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.384706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.385173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.385873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.386328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.386754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.520704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:22.529209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d33c5c86-5ad0-42c2-b752-dffd4414e4bf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156181 Aug 23 22:55:22.529783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1232/2488] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:22.715434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:22.716535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:22.724631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.725071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.725511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.726210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.726659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.727076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.805673 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:22.806410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:22.814399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.820155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.820155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.820155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:22.820155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:22.820971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:22.886934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:22.892856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:22.901911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-546c3b0e-6e54-4739-a215-7a28fcbdcb00 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.188229 Aug 23 22:55:22.901911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1257/2489] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:22 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:22.903157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-603e271f-68a5-40e4-a15d-2410488249c5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.101641 Aug 23 22:55:22.904032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1233/2490] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:23.551188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:23.551808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:23.557997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.558489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.558927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:23.559625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.560074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.560499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:23.698971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:23.701187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:23.708918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd1af041-4166-455e-885f-8f2704ec72c3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161653 Aug 23 22:55:23.713376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1258/2491] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:23.923107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:23.923694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:23.925250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:23.925863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:23.930314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.930805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.931244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:23.931943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.932397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.932525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.932822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:23.932970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.933464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:23.934154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:23.934603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:23.935021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:24.003261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:24.018372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f8fbb4fe-95ff-4bae-b600-bb9017249ec3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.097399 Aug 23 22:55:24.018960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1259/2492] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:24.070297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:24.078790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1cb61d93-da48-48ec-85f2-68320957e5f3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159974 Aug 23 22:55:24.079366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1234/2493] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:23 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:24.733323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:24.734299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:24.740407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:24.740896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:24.741368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:24.742064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:24.742517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:24.742943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:24.875393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:24.883791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b4acc793-3930-4d24-9513-1b63405f631c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154440 Aug 23 22:55:24.888419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1260/2494] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:25.040273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:25.040892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:25.048659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.053345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.053345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:25.053345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.053345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.053893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:25.102847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:25.103636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:25.110783 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.111264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.111700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:25.112399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.112847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.113299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:25.116405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:25.125804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fe4cdfc0-f263-4f2a-965c-3d74410f6b7a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089710 Aug 23 22:55:25.126472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1235/2495] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:25.255391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:25.263696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-528e0eae-8977-4e8d-b655-2e9d519e3c84 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.166632 Aug 23 22:55:25.264315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1261/2496] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:25 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:25.907152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:25.907681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:25.914064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.914552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.914987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:25.915681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:25.916132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:25.916554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:26.052331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:26.060615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-856eb0c9-5496-4b29-9936-f6f49141562a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159269 Aug 23 22:55:26.061723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1236/2497] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:26.146899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:26.147504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:26.154035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:26.154518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:26.155091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:26.155769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:26.156216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:26.156632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:26.225652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:26.235436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b6d6be83-701f-4e9f-9e5c-342ffe894376 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092588 Aug 23 22:55:26.236014 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1262/2498] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:26.284602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:26.285241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:26.291551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:26.292032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:26.292464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:26.293188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:26.293639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:26.294055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:26.431126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:26.440641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c94d9a2a-7901-4599-97f1-ece9a68f42af tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.159839 Aug 23 22:55:26.441263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1237/2499] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:26 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:27.082707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:27.083493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:27.089527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.090018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.090459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.091158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.091614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.092070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.237114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:27.245544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ec1e3bae-b890-428c-96d4-61b7a4a12c2b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.166657 Aug 23 22:55:27.246118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1263/2500] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:27.257356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:27.257935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:27.264037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.265268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.271241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.271241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.271241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.271241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.334191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:27.343087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-170000cf-1c78-417b-bcb3-c7ff2e9a9bc5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089417 Aug 23 22:55:27.344085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1238/2501] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:27.462104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:27.466434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:27.469243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.469728 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.470159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.470847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:27.471289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:27.471766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:27.615928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:27.625440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1d9eec8e-ca3b-434a-b586-9a482c76ead8 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.167190 Aug 23 22:55:27.626033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1264/2502] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:27 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:28.267708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:28.268346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:28.274913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.275398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.275838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.276535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.276989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.277457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.364508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:28.365157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:28.371827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.372317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.372741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.373569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.374017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.374436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.419248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:28.428445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d48d2b19-1b2b-47d7-a512-442e4accb834 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164584 Aug 23 22:55:28.431300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1239/2503] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:28.442138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:28.449932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3029aa50-e26a-4907-afdd-ad5d512f6c38 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089286 Aug 23 22:55:28.450505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1265/2504] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:28.647061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:28.647669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:28.653737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.654218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.654726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.656003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:28.656460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:28.656881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:28.956992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:28.968804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c21f3df2-d7b0-4021-9017-4059a5d9765d tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.325558 Aug 23 22:55:28.969437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1240/2505] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:28 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:29.449894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:29.450498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:29.457374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.457850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.458281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:29.458960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.459403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.459817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:29.470609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:29.471214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:29.477613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.478098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.478528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:29.479208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.479657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.480077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:29.543033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:29.552820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f2d3b18c-c15e-4409-89f5-b416c5768552 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085910 Aug 23 22:55:29.553684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1241/2506] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:29.596889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:29.605362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6cf5b6f7-4e38-4091-a395-c5d25e7b8a43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159204 Aug 23 22:55:29.605927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1266/2507] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:29.990382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:29.990911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:29.996958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.997517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.997954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:29.998709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:29.999163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:29.999589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:30.138726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:30.147926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ccf840e-5398-42e8-81a9-a473d6720873 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.161457 Aug 23 22:55:30.148499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1242/2508] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:29 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:30.574111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:30.574907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:30.581914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:30.583486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:30.583975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:30.584666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:30.585152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:30.585578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:30.629896 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:30.630521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:30.637805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:30.638300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:30.638740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:30.639444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:30.639901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:30.640380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:30.651551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:30.661417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-80af3d57-1217-45f7-b6ad-646c7fbdca0d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091094 Aug 23 22:55:30.662033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1267/2509] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:30.782483 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:30.791480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e40cd30-ae78-4fcd-866e-2f5cf39f3dea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.168286 Aug 23 22:55:30.792053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1243/2510] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:31.170757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:31.171373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:31.178454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.178946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.179388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.180088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.180541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.180966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.316952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:31.325352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0cfe5519-87cf-497f-afae-fb3bfcead444 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.158379 Aug 23 22:55:31.325932 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1268/2511] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:31 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:31.686787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:31.687393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:31.694470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.694951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.695387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.696073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.696526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.696940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.760665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:31.762967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:31.770380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c56e894b-bc4a-4de2-95ea-f5fd8ef0d6ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087651 Aug 23 22:55:31.773117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1244/2512] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:31.813246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:31.813900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:31.820229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.820705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.821165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.821847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:31.822289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:31.822703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:31.959569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:31.968955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5a7b81bd-09f4-4fb8-83a2-670465026443 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159615 Aug 23 22:55:31.969675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1269/2513] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:32.346727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:32.347352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:32.353681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:32.354182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:32.354603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:32.355281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:32.355734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:32.356161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:32.512773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:32.523115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-50bd9fea-aea6-47c4-83cd-43db9a11c9c4 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.180737 Aug 23 22:55:32.523680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1245/2514] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:32 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:32.793316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:32.793845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:32.801126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:32.801637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:32.802084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:32.802768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:32.803217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:32.803673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:32.880797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:32.880797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d5a8a786-846f-4d09-b1f4-732acec3a503 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088115 Aug 23 22:55:32.880797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1270/2515] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:32.993575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:32.994194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:33.000811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.001336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.001866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.002600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.003060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.003485 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.142651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:33.151776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ea70341a-8482-4b27-858b-8dd55dd0c740 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162206 Aug 23 22:55:33.152336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1246/2516] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:33.553521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:33.554134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:33.560317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.560805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.561266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.561961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.562409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.562829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.709630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:33.717887 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8eb4d17f-50a0-4d05-b1c0-94c938d7aad3 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.168672 Aug 23 22:55:33.718460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1271/2517] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:33 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:33.901436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:33.902328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:33.909043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.909529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.909967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.910695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:33.911150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:33.911583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:33.979070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:33.988091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5b8ff527-9dc3-42d2-9b2a-daed1c594415 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092854 Aug 23 22:55:33.988656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1247/2518] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:34.174458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:34.175191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:34.181543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:34.182020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:34.182448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:34.183129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:34.183572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:34.183988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:34.350043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:34.350043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-877ba2d9-3f44-47b0-990d-b8685414cfff tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153735 Aug 23 22:55:34.350043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1272/2519] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:34.739365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:34.740598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] [instance: ff6f94ec-9724-4f7a-82e3-68d1713bb26c] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:34.747001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:34.747493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:34.747931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:34.748623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:34.749139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:34.749597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:34.883467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc12894a7c94ae1b06340353fd99654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b0a6a36fb4c14816d9f94b270686c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:34.892972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0018e1f-dc92-404c-a03a-e2320566eb90 tempest-VolumesSnapshotTestJSON-1486152270 tempest-VolumesSnapshotTestJSON-1486152270-project] 10.222.0.73 "GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c" status: 200 len: 1558 microversion: 2.1 time: 0.157225 Aug 23 22:55:34.893571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1248/2520] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:34 2022] GET /compute/v2.1/servers/ff6f94ec-9724-4f7a-82e3-68d1713bb26c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:35.014326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:35.015289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:35.023114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:35.023594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:35.024204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:35.024591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:35.025107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:35.025618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:35.106602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:35.121760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d9fcb403-2d20-4cd0-a77c-d9252c1157bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.111618 Aug 23 22:55:35.122361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1273/2521] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:35.348918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:35.349495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:35.356284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:35.356738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:35.357206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:35.357897 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:35.358385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:35.358815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:35.491526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:35.499880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8a2eeca7-7f26-44df-b541-042f8b536cfc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154966 Aug 23 22:55:35.500536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1249/2522] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:36.143744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:36.144445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:36.151381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:36.151900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:36.152343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:36.153083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:36.153547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:36.153976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:36.222620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:36.230895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1e134195-42eb-4b9a-b0e1-427035dc03bb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091325 Aug 23 22:55:36.231465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1274/2523] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:36.521293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:36.522035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:36.528360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:36.528842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:36.529313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:36.530028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:36.530480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:36.530905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:36.665313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:36.674613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92fd281a-d2c8-4c1b-ab73-b45a717d3182 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157269 Aug 23 22:55:36.675175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1250/2524] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:37.253080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:37.253733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:37.259807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:37.260297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:37.260739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:37.261469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:37.261927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:37.262356 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:37.278238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:37.325602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:37.334353 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-45125eba-e30a-4144-87da-36e41d6d1686 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086177 Aug 23 22:55:37.334920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1275/2525] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:37.695556 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:37.696220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:37.702625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:37.703101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:37.703528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:37.704236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:37.704682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:37.705118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:37.834703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:37.843244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-828112d8-fdc7-4e33-bd3c-17d4fa9e327d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151484 Aug 23 22:55:37.843878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1251/2526] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:38.354235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:38.354825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:38.362604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:38.363151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:38.363585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:38.364270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:38.364715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:38.365164 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:38.428422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:38.436933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f347570-3d73-4223-8be0-e6c63705cdc2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086504 Aug 23 22:55:38.437561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1276/2527] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:38.866775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:38.867337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:38.873846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:38.874328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:38.874760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:38.875614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:38.876076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:38.876496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:39.016618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:39.025334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0c1e4002-5564-4db5-bf35-3dfe36f87def tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162550 Aug 23 22:55:39.025912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1252/2528] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:39.459350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:39.459963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:39.466352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:39.466854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:39.467284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:39.467959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:39.468401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:39.468816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:39.531007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:39.539424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34f7c327-cb06-4ece-bb3d-38513c392400 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085020 Aug 23 22:55:39.540181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1277/2529] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:40.048285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:40.048933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:40.051294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=74 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:40.056065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:40.056552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:40.056992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:40.057733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:40.058186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:40.058611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:40.189534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:40.197718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f0cf5c68-84f8-4d39-9d8c-cc5bf96f2738 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153967 Aug 23 22:55:40.198286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1253/2530] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:40.560028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:40.560644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:40.567245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:40.567735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:40.568208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:40.568918 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:40.569401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:40.569827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:40.636972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:40.645886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4b5ed7ce-cb2d-447b-8d4c-c92712acf10e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089832 Aug 23 22:55:40.646472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1278/2531] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:41.218983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:41.220364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:41.227043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:41.227527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:41.227962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:41.228650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:41.229130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:41.229555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:41.363238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:41.371423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-67edaf60-b09b-4dcd-aa27-47e15059d174 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156486 Aug 23 22:55:41.371992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1254/2532] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:41.667641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:41.668259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:41.675319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:41.675804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:41.676239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:41.676921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:41.677403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:41.677821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:41.740337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:41.748559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-749f1a2b-58af-4266-9c97-85697d65ba6b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084816 Aug 23 22:55:41.749158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1279/2533] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:42.393583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:42.394202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:42.400630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:42.401145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:42.401583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:42.402265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:42.402714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:42.403137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:42.541576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:42.551420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0f9077a5-78f4-4aa1-9b31-f4939e6655e6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162362 Aug 23 22:55:42.552012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1255/2534] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:42.770982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:42.771538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:42.778039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:42.778522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:42.778964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:42.779662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:42.780116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:42.780538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:42.844209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:42.853207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c9d8037b-19f6-41ae-b592-9a7ad3cbcb2c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086154 Aug 23 22:55:42.853786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1280/2535] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:43.573158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:43.573776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:43.580595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:43.581530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:43.581530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:43.582206 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:43.582654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:43.583073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:43.715293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:43.723912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-109da59f-dd69-4ec4-b23d-bb82a95d65cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154627 Aug 23 22:55:43.724474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1256/2536] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:43.873814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:43.874372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:43.881635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:43.882123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:43.882560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:43.883252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:43.883701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:43.884125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:43.947541 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:43.956899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-74c0ee5f-9746-43b6-bb93-2544c84f9e50 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087006 Aug 23 22:55:43.957509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1281/2537] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:44.745118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:44.745749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:44.752157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:44.752631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:44.753081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:44.753774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:44.754211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:44.754629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:44.885948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:44.894685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-03fc1884-d2cb-450d-84c0-b020cd2548ee tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153407 Aug 23 22:55:44.895284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1257/2538] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:44.977548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:44.978150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:44.980558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=72 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:44.985495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:44.985982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:44.986415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:44.987110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:44.987560 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:44.987978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:45.055523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:45.064390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d0564ca7-ee17-4674-91d7-4b5fe6150cae tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090577 Aug 23 22:55:45.065000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1282/2539] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:45.917113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:45.917699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:45.924969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:45.925476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:45.925906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:45.926594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:45.927040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:45.927454 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:46.054847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:46.063680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-28d22797-77d2-4bd4-a6df-efa5a23b5c06 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150223 Aug 23 22:55:46.064246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1258/2540] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:46.084769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:46.085423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:46.091890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:46.092376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:46.092812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:46.093562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:46.094533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:46.095041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:46.157889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:46.166402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-29af38bc-041c-4172-9390-4a6f06d27a09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085417 Aug 23 22:55:46.166970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1283/2541] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:47.085771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:47.086374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:47.092689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:47.093209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:47.093643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:47.094356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:47.094801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:47.095219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:47.186764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:47.187374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:47.194646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:47.195140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:47.195575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:47.196261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:47.196705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:47.197156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:47.228954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:47.237931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e997408a-3f7d-42ce-9586-731b3db86b49 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155946 Aug 23 22:55:47.238515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1259/2542] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:47.269634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:47.277851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf18c4bb-bb4f-4eab-bb8d-181db8271a21 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094851 Aug 23 22:55:47.278420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1284/2543] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:48.260672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:48.261300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:48.268318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:48.268795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:48.269263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:48.269953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:48.270396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:48.270841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:48.300280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:48.300901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:48.307669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:48.308158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:48.308596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:48.309319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:48.309776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:48.310204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:48.377137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:48.385421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31273ad0-5a81-4f12-aef4-a52b12f77b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089415 Aug 23 22:55:48.386059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1285/2544] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:48.406513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:48.415511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-57e940b8-28b7-4997-ba86-bdd716dc5d26 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158962 Aug 23 22:55:48.416075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1260/2545] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:49.407283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:49.407927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:49.414618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:49.415104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:49.415544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:49.416232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:49.416696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:49.417154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:49.436433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:49.437060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:49.444319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:49.444804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:49.445381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:49.446099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:49.446553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:49.446974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:49.463083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:49.482408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:49.492025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-43b25d04-ca9e-4a18-98a7-0f4be600b0b4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088501 Aug 23 22:55:49.492864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1286/2546] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:49.586268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:49.594562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8bc91a3b-0e4c-4c0f-a0fb-ba1f6804a915 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162084 Aug 23 22:55:49.595323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1261/2547] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:50.513632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:50.514197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:50.520558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:50.521066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:50.521497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:50.522175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:50.522619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:50.523027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:50.587896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:50.597123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c4740f6b-00ec-4749-bde6-9daee9afb565 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087394 Aug 23 22:55:50.597706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1287/2548] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:50.616651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:50.617310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:50.623675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:50.624153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:50.624584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:50.625322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:50.625776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:50.626185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:50.757502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:50.765794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92e0889f-3cd4-4849-81f0-18260fbb8b74 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153063 Aug 23 22:55:50.766641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1262/2549] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:51.618226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:51.618836 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:51.626293 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:51.626985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:51.627443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:51.628142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:51.628591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:51.629032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:51.690037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:51.698034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-905b5a5e-ada9-4ef2-a1b5-b4d20df05606 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084043 Aug 23 22:55:51.698597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1288/2550] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:51.786901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:51.787796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:51.794205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:51.794704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:51.795115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:51.795795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:51.796246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:51.796668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:51.928467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:51.937219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-69997868-bfcf-4898-9b47-6c58644d9073 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154148 Aug 23 22:55:51.938402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1263/2551] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:52.719363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:52.719968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:52.726493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:52.726971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:52.727400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:52.728077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:52.728522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:52.728937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:52.792779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:52.800982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-682329e6-bcd9-4d9d-8c17-2101f4ad6f9c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086160 Aug 23 22:55:52.801596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1289/2552] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:52.959742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:52.960357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:52.966841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:52.967329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:52.967768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:52.968463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:52.968985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:52.969462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:53.102903 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:53.111365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1e8e7497-0f33-4167-b28d-4840c356e350 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155458 Aug 23 22:55:53.111929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1264/2553] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:53.821366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:53.821929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:53.828410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:53.828902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:53.829370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:53.830067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:53.830520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:53.830947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:53.897032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:53.905374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-694c2fe1-9279-47c8-93f5-595d62c4702a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087969 Aug 23 22:55:53.905947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1290/2554] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:54.132531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:54.133116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:54.139473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:54.139949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:54.140382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:54.141759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:54.142203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:54.142618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:54.270993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:54.279352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-77898561-252d-4cba-b548-890eb05c1021 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150792 Aug 23 22:55:54.279938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1265/2555] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:54.927891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:54.928453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:54.934879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:54.935376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:54.935817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:54.936509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:54.936963 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:54.938040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:55.003326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:55.011589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d7f040c9-7b1e-4c63-9d04-17466fe35531 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087644 Aug 23 22:55:55.012161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1291/2556] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:55:55.301767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:55.302386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:55.308920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:55.309451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:55.309888 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:55.310580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:55.311037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:55.311464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:55.441344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:55.449543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-21b644be-cd86-4d9b-adad-374fe2d4c9ea tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151664 Aug 23 22:55:55.456053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1266/2557] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:56.038174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:56.038771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:56.045225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:56.045704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:56.046136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:56.047403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:56.047858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:56.048268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:56.050815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:55:56.110953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:56.119261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-df08f5e2-f1ba-41c3-89a8-484d8524a2a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085132 Aug 23 22:55:56.119832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1292/2558] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:56.472721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:56.473346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:56.479851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:56.480333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:56.480764 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:56.481486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:56.481940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:56.482363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:56.618003 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:56.626930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-51604733-70c4-4abe-9d4a-54fe166fc58d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158976 Aug 23 22:55:56.627502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1267/2559] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:57.139882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:57.140503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:57.147008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:57.147502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:57.147950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:57.148653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:57.149149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:57.149577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:57.212252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:57.220831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fdfae090-6c6a-46c2-97b9-a3d67d200163 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084930 Aug 23 22:55:57.221439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1293/2560] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:57.648187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:57.648785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:57.655379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:57.656390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:57.656918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:57.657704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:57.658165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:57.658597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:57.796723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:57.805109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-77972a50-745a-4a26-8244-4a22e6f60af6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160865 Aug 23 22:55:57.805688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1268/2561] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:58.241619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:58.242253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:58.248617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:58.249135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:58.249576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:58.250301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:58.250752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:58.251173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:58.318580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:58.326774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c9392817-83a2-47b1-8487-d944b771f6e7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088974 Aug 23 22:55:58.327342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1294/2562] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:58.826283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:58.826847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:58.833784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:58.834271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:58.834707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:58.835393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:58.835850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:58.836276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:58.970554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:58.979226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c9f6f386-c63d-4c8e-a26f-37c078eaa986 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156798 Aug 23 22:55:58.979815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1269/2563] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:55:59.346645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:55:59.347258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:55:59.353680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:59.354151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:59.354582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:59.355260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:55:59.355711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:55:59.356127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:55:59.418307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:55:59.427005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a9fea6f9-4aae-4f51-818e-67cdf464f674 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084206 Aug 23 22:55:59.427568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1295/2564] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:00.001342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:00.001989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:00.008522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:00.009000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:00.009457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:00.010137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:00.010583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:00.010998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:00.141812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:00.150086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3d0f1c45-2995-4351-88a5-87df5a861391 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153374 Aug 23 22:56:00.150658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1270/2565] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:55:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:00.447948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:00.448557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:00.455403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:00.455876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:00.456307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:00.456984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:00.457452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:00.457866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:00.519687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:00.528103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c381ba90-4b8d-4242-b7bd-bc95d635ed9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083914 Aug 23 22:56:00.528676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1296/2566] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:01.171822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:01.172529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:01.178979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:01.179468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:01.179906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:01.180596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:01.181075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:01.181503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:01.310345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:01.319631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c9f296b9-e55a-46fc-b9f4-6ad5a8967991 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151954 Aug 23 22:56:01.320199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1271/2567] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:01.553546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:01.554166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:01.560655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:01.561177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:01.561618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:01.562964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:01.563424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:01.563847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:01.626795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:01.634968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3821fdb1-4353-4c95-8645-d8d0b2a357dd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085300 Aug 23 22:56:01.635542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1297/2568] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:02.341637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:02.342280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:02.350035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:02.350524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:02.350973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:02.351663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:02.352118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:02.352543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:02.480227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:02.488776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-07f04793-7f63-4421-b0c3-b68b529fc751 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150956 Aug 23 22:56:02.489368 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1272/2569] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:02.655623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:02.656567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:02.662942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:02.663427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:02.663865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:02.664553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:02.665019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:02.665455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:02.730417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:02.738852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-785b778e-238a-4148-a54e-5dcfd733dc70 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087057 Aug 23 22:56:02.739424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1298/2570] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:03.509961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:03.510601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:03.518290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:03.518784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:03.519224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:03.519926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:03.520380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:03.520804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:03.654494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:03.664550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5e123b12-0009-4fc2-ac1e-70dcd681917b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158522 Aug 23 22:56:03.665171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1273/2571] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:03.759754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:03.760407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:03.767591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:03.768075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:03.768515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:03.769249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:03.769691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:03.770114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:03.834178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:03.842669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-555f2909-cb8a-47bf-abce-88c86dcfaecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086699 Aug 23 22:56:03.844180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1299/2572] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:04.686207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:04.687417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:04.693942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:04.694430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:04.694868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:04.695563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:04.696013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:04.696431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:04.828146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:04.836532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-64d7d126-34d2-40a2-9942-cb9279173690 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154195 Aug 23 22:56:04.837127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1274/2573] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:04 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:04.865814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:04.866421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:04.872813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:04.873337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:04.873775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:04.874516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:04.875007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:04.875436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:04.938138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:04.949794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78916ea5-640f-4ef8-b75a-1ac2ff86d9bc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087610 Aug 23 22:56:04.950390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1300/2574] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:05.858138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:05.858708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:05.865212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:05.865695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:05.866144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:05.866830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:05.867306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:05.867721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:05.971627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:05.972400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:05.979089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:05.979886 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:05.980192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:05.980957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:05.981524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:05.982016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:06.000171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:06.007473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7995b6af-3d16-4d89-a234-6a6c27d49990 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153237 Aug 23 22:56:06.008107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1275/2575] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:06.047176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:06.054914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-727e849c-5f4e-44b3-856f-ea53f9ab0703 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087772 Aug 23 22:56:06.055485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1301/2576] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:07.029379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:07.030081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:07.037121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:07.037622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:07.038061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:07.038797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:07.039251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:07.039689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:07.076005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:07.076563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:07.083073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:07.083589 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:07.084022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:07.084791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:07.085285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:07.085700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:07.151495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:07.160583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-985f1b8c-d11a-4761-a8ac-bc8b9f12aa15 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088592 Aug 23 22:56:07.168808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1302/2577] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:07.178704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:07.188233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0ec7bb8d-302a-4347-a4ad-add6367aaced tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162704 Aug 23 22:56:07.188821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1276/2578] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:08.182751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:08.183349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:08.190017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:08.190500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:08.190934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:08.191616 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:08.192070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:08.192488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:08.209402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:08.210024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:08.216500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:08.216994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:08.217460 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:08.218756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:08.219215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:08.219644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:08.255585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:08.264217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6ac35fc8-174c-4026-91a9-13bda08fd64a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085216 Aug 23 22:56:08.265501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1303/2579] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:08.350526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:08.358739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-617f4d7c-bc05-4f50-994e-7a2937d781b7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153149 Aug 23 22:56:08.359306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1277/2580] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:09.286221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:09.287158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:09.293368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:09.293847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:09.294274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:09.294950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:09.295395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:09.296201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:09.363494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:09.368612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-56c6a81f-e40b-496a-b6d7-32a133c7d800 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086362 Aug 23 22:56:09.369219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1304/2581] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:09.380046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:09.380753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:09.387352 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:09.387841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:09.388282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:09.388971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:09.389452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:09.390494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:09.393097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:09.521817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:09.529981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-eb7f0ab9-7c19-4ad4-b9eb-60c386a39cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153791 Aug 23 22:56:09.530763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1278/2582] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:10.390368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:10.390955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:10.397472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:10.397978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:10.398410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:10.399086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:10.399531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:10.399945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:10.461718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:10.470868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-516c14a9-75ff-47e9-a78b-ccb68cc1d865 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084460 Aug 23 22:56:10.471451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1305/2583] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:10.551039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:10.551652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:10.553944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=52 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:10.558790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:10.559276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:10.559707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:10.560393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:10.560841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:10.561282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:10.693378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:10.702910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c3ba271a-3efa-4adb-87a1-c75f84f75728 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155024 Aug 23 22:56:10.703619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1279/2584] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:11.491313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:11.491928 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:11.498473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:11.499257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:11.499756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:11.500448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:11.500896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:11.501350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:11.566176 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:11.574415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fd2ac3c2-1363-47ca-bf8b-01289940f22a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087003 Aug 23 22:56:11.574978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1306/2585] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:11.723791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:11.724417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:11.730954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:11.731443 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:11.731883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:11.732576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:11.733054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:11.733549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:11.862998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:11.871189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-850021e4-7f55-4165-9d34-ae0c4597e664 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151307 Aug 23 22:56:11.871748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1280/2586] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:11 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:12.595665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:12.596279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:12.602981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:12.603465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:12.603902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:12.604598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:12.605091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:12.605519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:12.667627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:12.676237 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c91dd22a-e536-4574-8904-99d01691d038 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084611 Aug 23 22:56:12.676814 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1307/2587] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:12.894185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:12.894745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:12.901175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:12.901665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:12.902121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:12.902793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:12.903251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:12.903675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:13.037573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:13.046256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4a2227b0-8b13-4c9b-b7bf-51040ef67101 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155605 Aug 23 22:56:13.047000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1281/2588] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:13.229848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:56:13.230109 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:56:13.697980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:13.698663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:13.705289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:13.705878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:13.706211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:13.706900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:13.707347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:13.707761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:13.770246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:13.772395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:13.779022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1b915d06-235d-46af-899e-2c96ebb3fb79 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084908 Aug 23 22:56:13.779586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1308/2589] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:14.067578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:14.068203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:14.074664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:14.075146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:14.075576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:14.076263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:14.076711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:14.077911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:14.211288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:14.219439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-54768c6a-8fa5-4ca6-bfb8-67674026b8e5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155683 Aug 23 22:56:14.220008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1282/2590] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:14.805320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:14.805938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:14.812857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:14.813305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:14.813745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:14.814437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:14.814898 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:14.815322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:14.877545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:14.885866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-55c3424a-3d50-4c9b-ac30-e0c39b629441 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084387 Aug 23 22:56:14.886441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1309/2591] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:14 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:15.240572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:15.241242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:15.247695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:15.248175 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:15.248608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:15.249415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:15.249867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:15.250296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:15.385891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:15.395210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92748ef5-2e78-4992-883a-2249236445d3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158500 Aug 23 22:56:15.395777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1283/2592] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:15.964615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:15.965264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:15.967600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=56 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:15.974162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:15.974647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:15.975080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:15.975769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:15.976221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:15.976642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:16.042834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:16.051344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae1bdd32-48fd-486b-85ee-04c65848b568 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090577 Aug 23 22:56:16.051905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1310/2593] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:16.415961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:16.416594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:16.423099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:16.423572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:16.424001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:16.424675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:16.425158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:16.425574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:16.554962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:16.563797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-609cd474-8fe3-4a70-94bc-b7b4921b224e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151660 Aug 23 22:56:16.564369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1284/2594] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:17.072242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:17.072900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:17.080543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:17.081196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:17.081628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:17.082329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:17.082779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:17.083197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:17.147544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:17.156288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-20744cb4-a6eb-4db5-9c74-2988326a202c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087793 Aug 23 22:56:17.156782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1311/2595] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:17.586600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:17.587209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:17.594127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:17.606477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:17.606477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:17.606477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:17.606477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:17.606911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:17.733101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:17.741491 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c4fbbab5-14d6-4f4f-af78-af49bb178cc0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158661 Aug 23 22:56:17.742057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1285/2596] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:18.177604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:18.178244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:18.184757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:18.185277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:18.185715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:18.187172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:18.187623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:18.188044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:18.413321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:18.421500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ebfa4af-bc44-4cd3-8c95-fa5a15431461 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.247709 Aug 23 22:56:18.422062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1312/2597] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:18.763866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:18.764664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:18.771281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:18.771770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:18.772211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:18.772922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:18.773476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:18.773904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:18.997211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:19.014656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-02efb899-4d24-4e15-a7b2-1c88db214e43 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.254202 Aug 23 22:56:19.015255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1286/2598] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:18 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:19.442120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:19.442675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:19.448974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:19.449475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:19.449904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:19.450576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:19.451016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:19.451427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:19.513658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:19.522459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e78c873f-55b1-4cb7-ab5e-24561299245c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084209 Aug 23 22:56:19.523020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1313/2599] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:20.036655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:20.037311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:20.043731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:20.044214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:20.044648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:20.046036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:20.046634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:20.047064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:20.175302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:20.183420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b9d01e31-4891-4011-b446-5f721d53345b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150949 Aug 23 22:56:20.183989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1287/2600] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:20.543206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:20.544022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:20.551026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:20.551525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:20.551956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:20.552654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:20.553136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:20.553558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:20.673134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:20.681387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-84336a6a-f783-4cbe-86c8-b2a6d8220378 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.142203 Aug 23 22:56:20.681935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1314/2601] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:21.204497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:21.205145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:21.211616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:21.212095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:21.212530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:21.213247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:21.213703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:21.214121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:21.345339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:21.355681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-46fd4559-9e3f-4b95-bead-67c208063ba1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154657 Aug 23 22:56:21.356722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1288/2602] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:21.703727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:21.704340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:21.710772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:21.711258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:21.711698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:21.712386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:21.712840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:21.713295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:21.776352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:21.785400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-33f80559-ad75-456f-869f-317b1a30fe37 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086344 Aug 23 22:56:21.786213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1315/2603] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:22.378937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:22.379528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:22.385900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:22.386375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:22.386812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:22.387486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:22.387934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:22.388345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:22.524030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:22.533041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6aada8e6-ea3a-475d-a7e4-56548937a46b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157911 Aug 23 22:56:22.533618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1289/2604] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:22.810633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:22.812023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:22.818779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:22.819261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:22.819691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:22.820385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:22.820832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:22.821279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:22.885773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:22.894358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-277b9d4d-a682-488d-aa7d-8dc6e0f14c85 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087574 Aug 23 22:56:22.894920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1316/2605] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:23.557575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:23.557991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:23.564432 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:23.564918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:23.565388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:23.566082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:23.566808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:23.567572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:23.699452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:23.708476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-30046dfe-f44c-4aee-bc86-ca0a33126962 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155115 Aug 23 22:56:23.709075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1290/2606] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:23.916123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:23.916695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:23.923577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:23.924060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:23.924495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:23.925216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:23.925669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:23.926088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:23.989774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:23.997840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-54f82934-082d-4c1e-836f-027dfbef50ce tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085668 Aug 23 22:56:23.998481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1317/2607] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:24.730564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:24.731157 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:24.738232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:24.738712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:24.739144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:24.739835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:24.740283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:24.740701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:24.884696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:24.893895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b5293235-e5b2-445d-8c49-42dfccffe72d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167184 Aug 23 22:56:24.894472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1291/2608] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:25.019852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:25.021200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:25.030116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:25.030620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:25.031067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:25.031779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:25.032242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:25.032683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:25.105277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:25.115677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3f67a009-ffac-4a5f-8398-2384e3a6b698 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.101063 Aug 23 22:56:25.127089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1318/2609] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:25.915907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:25.916469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:25.922853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:25.923333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:25.923762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:25.924444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:25.924889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:25.925328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:26.057890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:26.066807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3a7e03cd-1de1-4e54-9d75-64cd35b536f1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154765 Aug 23 22:56:26.067399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1292/2610] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:26.135655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:26.136249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:26.143890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:26.144372 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:26.144801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:26.145638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:26.146089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:26.146503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:26.448459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:26.456914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8f24d190-48a7-40fe-a055-83832d14f78c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.325021 Aug 23 22:56:26.457663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1319/2611] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:27.087891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:27.088457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:27.095789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:27.096264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:27.096699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:27.097419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:27.097865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:27.098280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:27.234874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:27.243262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-93a11144-cee6-4f22-9315-78d52dcb7ff7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159245 Aug 23 22:56:27.243825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1293/2612] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:27.486140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:27.486759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:27.493378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:27.493896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:27.494338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:27.495039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:27.495494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:27.495917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:27.559117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:27.567393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-68374b42-6245-4469-a538-aee928fe5e45 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085973 Aug 23 22:56:27.567953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1320/2613] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:28.266038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:28.266678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:28.274032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:28.274521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:28.274966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:28.275663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:28.276114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:28.276545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:28.409093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:28.411933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:28.420821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e6251f6a-4163-4839-bb76-60542ad044df tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158405 Aug 23 22:56:28.424291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1294/2614] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:28.587743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:28.588366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:28.595630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:28.596137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:28.596572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:28.597289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:28.597749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:28.598194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:28.660415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:28.669207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aade1d54-eb38-41eb-9bc1-befb39e64a30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085276 Aug 23 22:56:28.669773 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1321/2615] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:29.444415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:29.445167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:29.452033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:29.452519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:29.452957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:29.453693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:29.454148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:29.454576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:29.588458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:29.597750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-84f3225f-3f5d-4389-9207-cf06212d623d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159141 Aug 23 22:56:29.598355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1295/2616] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:29.690624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:29.691245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:29.697647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:29.698131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:29.698571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:29.699260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:29.699713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:29.700134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:29.763724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:29.772136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-354c2e46-6d9d-4357-9ae2-6c1f6bb5fb24 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085534 Aug 23 22:56:29.772711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1322/2617] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:30.620325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:30.621004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:30.630898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:30.631244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:30.631686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:30.632390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:30.632838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:30.633295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:30.779834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:30.788738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-af9a5530-bc29-4d39-95e7-a45a6cc55cb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.172680 Aug 23 22:56:30.789336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1296/2618] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:30.793363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:30.793973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:30.800693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:30.801218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:30.801657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:30.802350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:30.802798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:30.803223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:30.870334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:30.878582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-73935584-062c-4142-b126-a581df0c986b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089173 Aug 23 22:56:30.879143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1323/2619] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:31.809963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:31.811098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:31.817519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:31.817999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:31.818427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:31.819101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:31.819546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:31.819959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:31.900160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:31.900779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:31.908633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:31.909154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:31.909598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:31.910304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:31.911433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:31.911866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:31.953618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:31.962016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a736bb15-e3c8-4113-8adc-9d6afb2ab33e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155942 Aug 23 22:56:31.962806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1297/2620] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:31 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:31.986080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:31.994403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-34227f86-bafa-4d35-b299-777355104feb tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.098370 Aug 23 22:56:31.994972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1324/2621] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:33.015001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:33.015654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:33.022328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:33.023055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:33.023500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:33.024193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:33.024649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:33.025128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:33.040897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:33.092666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:33.101448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-14954434-a8b4-41cc-a54e-dd5bd208bda2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090575 Aug 23 22:56:33.102211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1325/2622] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:33.130614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:33.131268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:33.137240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:33.137726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:33.138165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:33.139248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:33.139799 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:33.140229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:33.271225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:33.279504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-37082103-e713-4afe-8c83-e24aee1f50fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.300117 Aug 23 22:56:33.280077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1298/2623] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:34.123572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:34.124219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:34.131153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:34.131609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:34.132035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:34.132703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:34.133209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:34.133623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:34.196066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:34.205146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c22fb916-13a8-4117-8c48-309fab464ca7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085464 Aug 23 22:56:34.205701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1326/2624] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:34.301603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:34.302285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:34.308689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:34.309264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:34.309734 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:34.310468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:34.310955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:34.311420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:34.442083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:34.451409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-efeee371-d518-4306-aac6-fb1f9ae0ddc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154232 Aug 23 22:56:34.452173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1299/2625] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:35.225984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:35.226602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:35.233064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:35.233553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:35.233994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:35.234730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:35.235191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:35.235617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:35.300260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:35.310280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b97cbce7-e338-4b21-aa77-0da9dbccaba5 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087961 Aug 23 22:56:35.311152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1327/2626] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:35 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:35.474804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:35.475449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:35.481717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:35.482198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:35.482632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:35.483318 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:35.483885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:35.484341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:35.616721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:35.625612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cb79c877-94ba-4833-ab40-567538c4a0fd tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154549 Aug 23 22:56:35.626192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1300/2627] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:36.330531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:36.331089 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:36.337635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:36.338114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:36.338540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:36.339220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:36.339664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:36.340079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:36.400545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:36.409338 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8d82d8f7-dc5f-40d8-b98e-1b002b251f30 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082854 Aug 23 22:56:36.409908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1328/2628] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:36.646577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:36.647127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:36.653464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:36.653940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:36.654370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:36.655048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:36.656009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:36.656547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:36.788690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:36.797285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-064736aa-173c-444e-9b3d-f63dd68b04f0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154593 Aug 23 22:56:36.797859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1301/2629] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:37.430675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:37.431287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:37.438032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:37.438534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:37.438969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:37.439638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:37.440081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:37.440497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:37.502026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:37.510104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7a1e2bc1-e604-43d0-8b35-7ba5be835e2a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083250 Aug 23 22:56:37.510659 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1329/2630] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:37.818980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:37.819683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:37.826271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:37.826748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:37.827176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:37.827930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:37.828376 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:37.828795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:37.957242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:37.965681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0775e1a2-963e-4392-b052-0d8a992e8a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150643 Aug 23 22:56:37.966252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1302/2631] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:38.531903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:38.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:38.539146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:38.539623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:38.540060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:38.540749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:38.541235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:38.541676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:38.606189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:38.614465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-03f57555-6f32-4b30-aeac-a1c64bb4f1b2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087324 Aug 23 22:56:38.615024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1330/2632] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:38.987961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:38.988585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:38.995046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:38.995531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:38.995968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:38.996692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:38.997212 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:38.997641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:39.128653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:39.136906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e37978e5-377a-4e60-8429-c5d6781c3ef1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153564 Aug 23 22:56:39.137495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1303/2633] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:39.635834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:39.636453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:39.643304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:39.643818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:39.644257 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:39.644948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:39.645436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:39.645859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:39.711390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:39.720774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-32e93f5c-37a2-442e-b9cb-65247edeaa57 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088745 Aug 23 22:56:39.721409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1331/2634] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:40.157736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:40.158413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:40.165466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:40.165966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:40.166469 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:40.167202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:40.167679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:40.168130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:40.296573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:40.304832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8e5deed3-db38-4eb7-8066-285ecf1b5100 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151522 Aug 23 22:56:40.305445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1304/2635] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:40.740649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:40.741272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:40.747985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:40.748461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:40.748890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:40.750246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:40.750694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:40.751106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:40.813148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:40.821333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-10d669f8-b955-422a-97fb-df19de238049 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084748 Aug 23 22:56:40.821899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1332/2636] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:41.325874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:41.326504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:41.329730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=52 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:41.334512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:41.334993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:41.335423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:41.336109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:41.336561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:41.336980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:41.468303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:41.477195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-db3507d9-e064-4657-93d0-463e77c65f29 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155200 Aug 23 22:56:41.477761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1305/2637] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:41.841672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:41.842272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:41.849262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:41.849784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:41.850249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:41.850921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:41.851377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:41.851802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:41.915674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:41.924702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c1ea1b85-71b4-4f9e-9cdb-e1413798eb4c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086850 Aug 23 22:56:41.925306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1333/2638] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:42.498819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:42.499358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:42.506341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:42.506824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:42.507253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:42.507929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:42.508374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:42.508792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:42.639276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:42.648326 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-396abf99-a140-4c9e-bf63-7ef81e6d5fd5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153551 Aug 23 22:56:42.648890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1306/2639] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:42.946264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:42.946860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:42.953591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:42.954081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:42.954523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:42.955223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:42.955676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:42.956106 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:43.017441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:43.025717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8af81e54-3338-488e-a90a-01f47020a203 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083357 Aug 23 22:56:43.026265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1334/2640] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:43.669790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:43.670402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:43.677140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:43.677627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:43.678063 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:43.678747 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:43.679197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:43.679620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:43.823614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:43.833421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e56d2744-9b15-4403-81ae-087ac20d1b0e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167559 Aug 23 22:56:43.834076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1307/2641] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:44.047442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:44.048052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:44.054365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:44.054899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:44.055342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:44.056018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:44.056464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:44.056883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:44.121453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:44.130652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a8561082-b1d4-4945-a662-4dbbcba81886 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087162 Aug 23 22:56:44.131214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1335/2642] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:44.855828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:44.856381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:44.863674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:44.864161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:44.864598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:44.865362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:44.865824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:44.866253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:44.994658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:45.003541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5941530e-7a43-4793-bec7-fd30f93f8221 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151688 Aug 23 22:56:45.004148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1308/2643] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:45.152259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:45.152825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:45.160803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:45.161319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:45.161763 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:45.162454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:45.162951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:45.163375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:45.228078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:45.236703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-be3f40dd-80b8-43d9-a95a-3f159f38d74c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088608 Aug 23 22:56:45.237306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1336/2644] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:45 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:46.024986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:46.025602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:46.032610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:46.033089 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:46.033523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:46.034197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:46.034644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:46.035325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:46.166808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:46.175925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-07cefa8d-012c-4ab6-be00-b42138d8ebb3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154777 Aug 23 22:56:46.176497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1309/2645] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:46.257573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:46.258187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:46.260647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=54 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:46.265370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:46.265856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:46.266299 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:46.266981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:46.267436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:46.267892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:46.330152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:46.338981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7521301a-5d06-4c5d-896d-3f22329a1e19 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085256 Aug 23 22:56:46.339712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1337/2646] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:47.197027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:47.197638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:47.204582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:47.205098 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:47.205534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:47.206223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:47.206668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:47.207084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:47.342357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:47.351771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce73960f-6327-4662-aac6-cd18377bb9e1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158660 Aug 23 22:56:47.352350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1310/2647] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:47.359902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:47.360505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:47.366952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:47.367429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:47.367864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:47.368553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:47.368998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:47.369441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:47.431934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:47.440411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c22db46c-4f26-4d7a-b598-23d2bd0bd702 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084579 Aug 23 22:56:47.440975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1338/2648] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:48.372979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:48.373636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:48.380783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:48.381319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:48.381756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:48.382455 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:48.382914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:48.383343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:48.399241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:48.462125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:48.462833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:48.470162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:48.471203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:48.471203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:48.472080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:48.472590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:48.473042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:48.529034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:48.538787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-879f5b24-a89b-4a5d-94b9-de67c841d8b3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.169522 Aug 23 22:56:48.539458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1311/2649] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:48.546039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:48.556483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-406f5033-82c1-4357-9a47-e9d7bb9fb993 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.098107 Aug 23 22:56:48.557099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1339/2650] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:49.560543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:49.561307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:49.568548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:49.569134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:49.569513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:49.570210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:49.570696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:49.571096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:49.578816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:49.579428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:49.585855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:49.586339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:49.586778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:49.587473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:49.587924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:49.588346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:49.651123 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:49.660619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2b27d7a1-654d-4b2e-aa41-346f2edca7c1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085623 Aug 23 22:56:49.661225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1340/2651] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:49.709884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:49.718948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-14b4f6da-ec44-4728-bfaf-663e845063b4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162824 Aug 23 22:56:49.719521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1312/2652] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:50.740342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:50.741054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:50.747508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:50.747998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:50.748444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:50.749672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:50.750135 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:50.750640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:50.793564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:50.794232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:50.800442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:50.800951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:50.801427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:50.802147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:50.802729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:50.803037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:50.867962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:50.877390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9a2fa1f2-30ef-430a-8529-529d4455f92e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.199018 Aug 23 22:56:50.877794 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1341/2653] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:50.879894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:50.888267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a51fa94c-2621-4b21-966c-ff01e1c39673 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151748 Aug 23 22:56:50.888971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1313/2654] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:51.898637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:51.899206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:51.905908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:51.906401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:51.906844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:51.907532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:51.907988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:51.908414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:51.910105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:51.910843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:51.912855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:56:51.917329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:51.917810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:51.918267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:51.919014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:51.919467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:51.919884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:51.975665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:51.984876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3673cb9e-97b1-4f15-899c-3b6d45c082c4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090098 Aug 23 22:56:51.985486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1342/2655] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:52.054179 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:52.062892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e530523e-fc88-4048-9ee2-f1128d10ab2e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157000 Aug 23 22:56:52.063496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1314/2656] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:53.006903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:53.007499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:53.013946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:53.014419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:53.015631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:53.016409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:53.016857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:53.017297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:53.084463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:53.085539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:53.086256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:53.092641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:53.093591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eeead5e9-1151-4267-ba36-265f1a5cac9f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089823 Aug 23 22:56:53.093728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:53.093845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1343/2657] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:53.093952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:53.094381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:53.094830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:53.095251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:53.463105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:53.471630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-23f61a29-f982-4258-a213-a5334e5c614a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.390492 Aug 23 22:56:53.472198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1315/2658] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:54.113754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:54.114373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:54.121654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:54.122142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:54.122594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:54.123285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:54.123739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:54.124191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:54.186628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:54.194841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b5efee41-d3db-4d25-a577-e48342ebe04b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085062 Aug 23 22:56:54.195425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1344/2659] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:54.493230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:54.493852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:54.500894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:54.501412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:54.501860 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:54.502558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:54.503019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:54.503449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:54.633655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:54.642498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-651cdfa2-fb5b-47c7-a3e4-b05c981f518d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153247 Aug 23 22:56:54.643072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1316/2660] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:55.216281 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:55.216897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:55.223846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:55.224333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:55.224779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:55.225500 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:55.225956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:55.226378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:55.288609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:55.297759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-adf9a4a6-e268-4e87-945e-0be2647bb069 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085444 Aug 23 22:56:55.298322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1345/2661] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:55.663286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:55.663898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:55.670358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:55.671090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:55.671757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:55.672494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:55.672951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:55.673411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:55.806651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:55.815508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2405f2e5-525b-4c26-a36c-3bef4872631e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156286 Aug 23 22:56:55.816005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1317/2662] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:56.318747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:56.319386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:56.325871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:56.326364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:56.326803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:56.327493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:56.327946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:56.328373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:56.389415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:56.397756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-20885d77-cc03-4d97-af7b-5e0d0caf0567 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082932 Aug 23 22:56:56.398318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1346/2663] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:56 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:56.837440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:56.838036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:56.844996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:56.845513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:56.845942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:56.846626 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:56.847075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:56.847527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:56.975957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:56.984397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-09153d62-04a5-4368-89fa-1de0c1f1c4d5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151032 Aug 23 22:56:56.984974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1318/2664] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:57.419070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:57.419685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:57.426233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:57.426798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:57.427267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:57.427950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:57.428402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:57.428892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:57.492869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:57.502330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8b679cd6-6cb9-4200-9808-4cd8a6707fbf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087278 Aug 23 22:56:57.502894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1347/2665] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:58.006333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:58.006943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:58.013374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:58.013862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:58.014302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:58.015072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:58.015520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:58.015982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:58.107854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:56:58.108785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:56:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 (ip 10.222.0.73) !!! Aug 23 22:56:58.153500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:58.162620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f4b4cf3c-66e1-4c5f-96a1-4fd28c5cb599 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160106 Aug 23 22:56:58.163193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1319/2666] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:58 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:58.523044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:58.523615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:58.531042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:58.531718 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:58.532159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:58.532857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:58.533341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:58.533766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:58.601622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:58.610498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c79dd318-838b-4067-8041-89f88d6ad83f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.091305 Aug 23 22:56:58.611075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1348/2667] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:56:59.184735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:59.185397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:59.192058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:59.192550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:59.192991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:59.193707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:59.194199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:59.194594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:59.325330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:59.334227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-655db465-5110-4075-a845-77fff264d979 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153414 Aug 23 22:56:59.338370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1320/2668] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:56:59.631450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:56:59.632122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:56:59.638663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:59.639145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:59.640153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:59.641046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:56:59.641503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:56:59.641940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:56:59.704558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:56:59.712770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b647c650-7c2a-4b69-b990-14fabaa0208e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085248 Aug 23 22:56:59.713375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1349/2669] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:56:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:00.355083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:00.355702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:00.362912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:00.363399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:00.363838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:00.364533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:00.364989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:00.365444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:00.493518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:00.501781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0c91c949-b9d4-4182-a8e6-00eacd397e45 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150576 Aug 23 22:57:00.502334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1321/2670] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:00.732746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:00.733514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:00.739994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:00.740480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:00.740917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:00.741634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:00.742088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:00.742513 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:00.805246 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:00.813654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ff888b93-372d-4269-8457-8d1ac5755712 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084991 Aug 23 22:57:00.814156 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1350/2671] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:01.523643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:01.524233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:01.531292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:01.531781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:01.532220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:01.532902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:01.533384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:01.533806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:01.670229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:01.678717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a287f7e7-93cd-4707-85ea-58b0b02bf992 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158918 Aug 23 22:57:01.679287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1322/2672] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:01.834788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:01.835368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:01.841717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:01.842193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:01.842714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:01.843387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:01.843854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:01.844270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:01.908872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:01.917424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c0d9fef0-0d1c-4414-8aa4-843b1c397532 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086507 Aug 23 22:57:01.917985 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1351/2673] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:02.699862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:02.700533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:02.707207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:02.707696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:02.708133 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:02.708820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:02.709309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:02.709770 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:02.839183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:02.848077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b091e37f-8245-436f-a7cc-8cac1cbc2a92 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152095 Aug 23 22:57:02.848644 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1323/2674] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:02.938415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:02.939019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:02.945402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:02.945880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:02.946309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:02.946983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:02.947425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:02.947838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:03.015873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:03.020225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-77f19b3c-90ce-4c04-9ba5-74391437b381 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085694 Aug 23 22:57:03.020789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1352/2675] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:03.870511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:03.871130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:03.878064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:03.878553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:03.878993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:03.879686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:03.880139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:03.880562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:04.015634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:04.023956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9a5891a3-a61a-48b5-bc9e-707410745858 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157390 Aug 23 22:57:04.024523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1324/2676] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:04.041441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:04.042085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:04.049188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:04.049731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:04.050171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:04.050856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:04.051310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:04.051733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:04.113279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:04.121572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-96b75796-52a9-4a9d-9013-683620752501 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083993 Aug 23 22:57:04.122137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1353/2677] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:04 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:05.045312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:05.046177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:05.052513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:05.052997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:05.053462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:05.054155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:05.054611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:05.055022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:05.142002 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:05.142614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:05.149219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:05.149709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:05.150497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:05.150862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:05.151306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:05.151720 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:05.190983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:05.199696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b84bd9ef-bacf-4c51-b102-ae7b179f3fec tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158406 Aug 23 22:57:05.200359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1325/2678] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:05.218280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:05.226629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cb225be6-81c6-4b04-9f7b-5e1a621d2803 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089048 Aug 23 22:57:05.227211 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1354/2679] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:05 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:06.222700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:06.223302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:06.229898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:06.230418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:06.230924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:06.231661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:06.232145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:06.232599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:06.249483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:06.250118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:06.256923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:06.256923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:06.257415 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:06.258161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:06.258682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:06.259112 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:06.329935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:06.338300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-743f9986-df63-4d8d-b0fb-a674fae27320 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.092846 Aug 23 22:57:06.339122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1355/2680] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:06 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:06.372700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:06.381583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9f18afbe-af47-4503-98bb-566d4bf24dd2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162910 Aug 23 22:57:06.382152 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1326/2681] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:07.359254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:07.360545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:07.367119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:07.367608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:07.368046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:07.368740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:07.369227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:07.369654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:07.403110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:07.403792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:07.411728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:07.412249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:07.412695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:07.413458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:07.413925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:07.414355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:07.433177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:07.441743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe2d9a1e-21a7-40c3-b5cb-41c90ff5ada9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086371 Aug 23 22:57:07.442331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1356/2682] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:07 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:07.549592 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:07.556797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b13fa60a-bc93-41fb-a2b1-f1127aa24acf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157468 Aug 23 22:57:07.557386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1327/2683] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:08.463810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:08.464573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:08.471657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:08.472148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:08.472613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:08.473342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:08.473798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:08.474253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:08.537837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:08.546391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0914f357-e30d-450e-a4f1-ac3afd8716e8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086341 Aug 23 22:57:08.546956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1357/2684] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:08 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:08.578113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:08.578722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:08.585481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:08.585954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:08.586385 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:08.587055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:08.587498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:08.587911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:08.591797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:08.718760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:08.727029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45d8657e-c66f-4ca3-a0b8-e490417ebdc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153678 Aug 23 22:57:08.727595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1328/2685] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:09.566919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:09.567534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:09.574022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:09.574508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:09.574947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:09.575635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:09.576092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:09.576518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:09.637910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:09.640850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:09.647550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3abdc63-fe5c-4f6b-a56c-6f6bca31e6fd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084491 Aug 23 22:57:09.653330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1358/2686] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:09 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:09.748669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:09.749980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:09.756452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:09.756926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:09.757387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:09.758068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:09.758514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:09.758929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:09.894069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:09.902159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-134f8f5b-44c8-4455-b6e5-b3f4adc85c7a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157692 Aug 23 22:57:09.902724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1329/2687] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:10.669388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:10.670618 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:10.677959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:10.678472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:10.678941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:10.679634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:10.680088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:10.680510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:10.750058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:10.758926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-424e4808-e0eb-44d3-8eaa-e733552a7c5e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093570 Aug 23 22:57:10.759583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1359/2688] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:10 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:10.925555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:10.926255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:10.933850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:10.934522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:10.935071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:10.935856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:10.936373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:10.936891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:11.069321 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:11.077729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-39267fdc-30d7-48c6-9097-f5f682bdf9cb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156452 Aug 23 22:57:11.078309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1330/2689] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:11.779943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:11.780532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:11.787236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:11.787715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:11.788154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:11.788840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:11.789319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:11.789740 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:11.851298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:11.859578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1a6a1200-3376-4bf0-872a-3f36bb7ddb62 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083490 Aug 23 22:57:11.860209 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1360/2690] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:11 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:12.098601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:12.099274 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:12.101552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=52 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:12.106369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:12.106911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:12.107866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:12.108574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:12.109055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:12.109492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:12.249565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:12.258199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0f556d75-f61c-433f-84bb-725d84757dd4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.163508 Aug 23 22:57:12.258790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1331/2691] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:12.879726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:12.880530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:12.887212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:12.887700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:12.888140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:12.889378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:12.889914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:12.890351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:12.954096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:12.962528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1ad7d432-0697-4e21-8809-9c7ecb1ee0ec tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086662 Aug 23 22:57:12.963111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1361/2692] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:12 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:13.280099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:13.280699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:13.287573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:13.288067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:13.288506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:13.289231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:13.289691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:13.290121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:13.426302 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:13.434593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-06ecbfb1-bb36-495e-8260-4074d4d488d0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158618 Aug 23 22:57:13.435154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1332/2693] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:13.984463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:13.985088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:13.991602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:13.992092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:13.992531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:13.993247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:13.993704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:13.994129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:14.058096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:14.066556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8cd16584-d6a7-4f98-a8fc-94d84ee30a94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086785 Aug 23 22:57:14.067128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1362/2694] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:13 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:14.456723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:14.457346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:14.463790 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:14.464265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:14.464697 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:14.465411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:14.465862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:14.466283 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:14.597359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:14.606102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d9c16b87-091c-4141-a52e-3c8cd0fd2a5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153189 Aug 23 22:57:14.606683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1333/2695] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:15.086722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:15.087352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:15.094594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:15.095084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:15.095520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:15.096218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:15.096672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:15.097130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:15.163043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:15.171696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-32ba8e84-05fb-4375-8635-59f32d90819d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088792 Aug 23 22:57:15.172279 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1363/2696] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:15 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:15.628325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:15.628961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:15.635541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:15.636035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:15.636498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:15.637215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:15.637678 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:15.638104 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:15.777335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:15.786347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b39dc590-9ad4-4915-908d-f4d68e3dbbfa tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162171 Aug 23 22:57:15.786916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1334/2697] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:16.192979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:16.193588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:16.199986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:16.200476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:16.200903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:16.202563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:16.209549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:16.209549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:16.266627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:16.274923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-58b13a15-09a8-4f66-b435-58574bb5e37f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085917 Aug 23 22:57:16.275488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1364/2698] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:16 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:16.808319 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:16.808893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:16.816715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:16.817314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:16.817818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:16.818578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:16.819088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:16.819571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:16.959357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:16.968604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9408111a-dfc7-4a64-897f-3ac3826ccbab tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.164403 Aug 23 22:57:16.969220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1335/2699] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:17.296055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:17.296658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:17.299053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=56 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:17.303818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:17.304309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:17.304746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:17.305481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:17.305964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:17.306365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:17.369451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:17.377672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4bf8000a-7398-4e61-a0f9-d7822f258828 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085777 Aug 23 22:57:17.378332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1365/2700] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:17 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:17.993297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:17.993932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:18.001284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:18.001779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:18.002220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:18.002917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:18.003374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:18.003831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:18.141695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:18.149925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-70e59750-4e9e-4c0a-91ee-869e8e0792c4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.160514 Aug 23 22:57:18.150495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1336/2701] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:18.398624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:18.399166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:18.406360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:18.406850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:18.407283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:18.407972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:18.408685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:18.409137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:18.472822 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:18.481119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-53c838a5-9767-4635-bc1a-1b80e4adf502 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086354 Aug 23 22:57:18.481781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1366/2702] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:18 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:19.172080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:19.172696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:19.179205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:19.179687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:19.180120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:19.180812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:19.181296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:19.181715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:19.346957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:19.355303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-50edc971-d5bc-4669-844b-d3a601b0204b tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.188017 Aug 23 22:57:19.355907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1337/2703] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:19.503043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:19.503654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:19.510087 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:19.510569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:19.510999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:19.511685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:19.512131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:19.512550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:19.579478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:19.587817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2dc69bc2-d2f0-4fdd-a9bd-475e59d90974 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089107 Aug 23 22:57:19.588388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1367/2704] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:19 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:20.378823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:20.379421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:20.385996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:20.386481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:20.386918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:20.387604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:20.388057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:20.388478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:20.524905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:20.537702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f93edce3-4319-43bf-b26c-360dae1d6345 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.163434 Aug 23 22:57:20.538280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1338/2705] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:20.609714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:20.610306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:20.616957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:20.617469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:20.617893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:20.618580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:20.619026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:20.619439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:20.686690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:20.695056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a0703da1-0f9e-4cc6-b57c-6e2a19d305d3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089947 Aug 23 22:57:20.695641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1368/2706] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:20 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:21.563029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:21.563662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:21.570091 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:21.570577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:21.571019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:21.571713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:21.572168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:21.572597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:21.706331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:21.714659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-733f70ba-4173-4ac5-854a-df7ef2e6181c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156538 Aug 23 22:57:21.715230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1339/2707] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:21.715697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:21.716442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:21.723973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:21.724464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:21.724902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:21.725631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:21.726085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:21.726511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:21.790343 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:21.799268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-46604658-efd5-4d2e-b026-e25e22d30e82 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087377 Aug 23 22:57:21.799885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1369/2708] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:21 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:22.736523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:22.737184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:22.744024 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:22.744520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:22.744989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:22.745724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:22.746193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:22.746621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:22.820062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:22.820676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:22.827307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:22.827870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:22.828395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:22.829193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:22.829708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:22.830192 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:22.885915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:22.893571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:22.894878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3149e299-f230-4709-9241-8fd746d58052 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162920 Aug 23 22:57:22.895590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1340/2709] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:22.902351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-faf1d289-0c67-4208-81c2-2fea570baa8d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086467 Aug 23 22:57:22.902943 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1370/2710] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:22 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:23.915956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:23.916531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:23.922911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:23.923396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:23.923833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:23.924502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:23.924947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:23.925392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:23.927015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:23.927631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:23.933959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:23.934482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:23.934904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:23.935581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:23.936029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:23.936451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:24.002061 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:24.010400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71225e36-6d07-43dd-bd73-6d7b763420f3 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087132 Aug 23 22:57:24.010970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1371/2711] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:23 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:24.058216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:24.066340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c64f73f3-5d9e-4555-a2d6-54a33a4c5d66 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154434 Aug 23 22:57:24.066905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1341/2712] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:25.032034 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:25.032647 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:25.039847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:25.040451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:25.040744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:25.041452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:25.041914 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:25.042321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:25.087854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:25.088585 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:25.096627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:25.097153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:25.097616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:25.098408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:25.099115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:25.099609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:25.106980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:25.115888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e74bfb33-ff30-4150-9db7-abf434358b29 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088166 Aug 23 22:57:25.121804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1372/2713] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:25 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:25.241448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:25.250942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-92f58b38-9f7c-4184-9a31-9903930b6ea1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.166979 Aug 23 22:57:25.251518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1342/2714] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:25 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:26.136761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:26.137422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:26.143923 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:26.144405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:26.144961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:26.146217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:26.147055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:26.147808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:26.214682 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:26.223038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-26cf7d9b-f5fc-4d02-850a-cd6463047c09 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090156 Aug 23 22:57:26.223602 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1373/2715] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:26 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:26.274357 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:26.275041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:26.282067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:26.282590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:26.283313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:26.284067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:26.284548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:26.285037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:26.424004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:26.432388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e2769bd6-05ed-42ed-9249-d5222f7516bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.162104 Aug 23 22:57:26.436555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1343/2716] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:27.244445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:27.245178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:27.252512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:27.253050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:27.253610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:27.254398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:27.254891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:27.255359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:27.319547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:27.327664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-45aa8665-9203-4e28-b1dc-d24e09ddd48e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087364 Aug 23 22:57:27.329152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1374/2717] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:27 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:27.456857 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:27.457520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:27.464797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:27.465325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:27.465762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:27.466465 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:27.466921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:27.467344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:27.600815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:27.603366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:27.610810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-75a18be4-ab2e-406a-862a-52b4f42f72e4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159288 Aug 23 22:57:27.614412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1344/2718] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:28.349804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:28.350477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:28.357811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:28.358376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:28.358848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:28.359622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:28.360073 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:28.360486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:28.377869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:28.430590 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:28.439428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97bf7a24-8985-461a-9cae-f7cf505af19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094013 Aug 23 22:57:28.439988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1375/2719] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:28 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:28.634911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:28.635501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:28.643101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:28.643419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:28.643847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:28.644523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:28.644972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:28.645411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:28.786359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:28.796229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-93f460cb-cbfb-4e21-8500-3a31aefdb87a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.165172 Aug 23 22:57:28.797369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1345/2720] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:29.460069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:29.460681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:29.467088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:29.467566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:29.467997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:29.469410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:29.469859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:29.470278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:29.533792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:29.541992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b54d4245-35ee-4cf4-870b-fc82e65e7417 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085783 Aug 23 22:57:29.542554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1376/2721] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:29 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:29.820052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:29.820706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:29.827456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:29.828647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:29.829429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:29.830160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:29.830641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:29.831115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:29.965032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:29.973679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ca193c3d-ca52-40c7-99d7-fb5d6c726d16 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157676 Aug 23 22:57:29.974287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1346/2722] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:30.564011 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:30.565128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:30.571547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:30.572036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:30.572467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:30.573196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:30.573645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:30.574063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:30.638185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:30.647175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f87ed5d8-4d6d-499c-8e47-1940dbb4275a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087146 Aug 23 22:57:30.647780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1377/2723] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:30 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:30.995389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:30.996041 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:31.003202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:31.003686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:31.004277 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:31.005035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:31.005508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:31.005940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:31.139325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:31.147702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f152b9e3-55da-4a8a-98be-b2314e410741 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156200 Aug 23 22:57:31.148360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1347/2724] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:31.669801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:31.670409 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:31.677722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:31.678201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:31.678629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:31.679313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:31.679760 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:31.680177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:31.744185 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:31.752717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2a8c3167-6df8-46d2-8d41-e8acfc9a0e7c tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088239 Aug 23 22:57:31.753364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1378/2725] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:31 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:32.170303 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:32.170967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:32.178880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:32.179395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:32.179838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:32.180573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:32.181127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:32.181567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:32.316398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:32.324831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fe6ec843-b8c5-473c-9d78-f33e9212e15e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158609 Aug 23 22:57:32.325509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1348/2726] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:32.773749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:32.774345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:32.780742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:32.781264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:32.781707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:32.782395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:32.783113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:32.783540 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:32.847114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:32.855285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-349070cb-20a9-438a-b3c3-8e28c721ca41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085383 Aug 23 22:57:32.855848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1379/2727] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:32 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:33.347700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:33.348379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:33.354772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:33.355263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:33.355737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:33.356428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:33.356883 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:33.357343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:33.483742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:33.492830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-22d86b5b-ac5c-4426-95b0-9c6585d1710a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149614 Aug 23 22:57:33.493433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1349/2728] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:33.876057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:33.876868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:33.883384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:33.883855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:33.884280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:33.884950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:33.885424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:33.885838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:33.947463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:33.967609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5690c553-e758-474b-a27a-03d8bff4d11b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083885 Aug 23 22:57:33.967609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1380/2729] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:33 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:34.513902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:34.514512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:34.521462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:34.521895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:34.522365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:34.523149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:34.523602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:34.524032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:34.659276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:34.667719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3bb47469-73ea-4dc9-a0c4-82382b67bde9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157668 Aug 23 22:57:34.668295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1350/2730] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:34.976833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:34.977677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:34.984242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:34.985497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:34.985497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:34.986716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:34.987172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:34.987598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:35.060282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:35.069095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31397a6a-1ad9-4fcf-9712-ecca6eda3394 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.096021 Aug 23 22:57:35.069789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1381/2731] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:34 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:35.690146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:35.690838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:35.697130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:35.697606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:35.698034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:35.698720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:35.699171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:35.699587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:35.835447 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:35.843796 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5c271ea0-312b-4ba7-8bbc-e14159b65d88 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158588 Aug 23 22:57:35.844354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1351/2732] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:36.090463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:36.091004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:36.098688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:36.099177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:36.099617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:36.100320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:36.100777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:36.101245 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:36.165910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:36.175137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfaa688e-f264-4b09-a753-7dbb1634808e tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088583 Aug 23 22:57:36.175730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1382/2733] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:36 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:36.864069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:36.864645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:36.871120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:36.872655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:36.872655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:36.872882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:36.873164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:36.873587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:37.008030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:37.016402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3d2ab5c9-2417-412c-a7df-fa64017078cf tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156602 Aug 23 22:57:37.017034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1352/2734] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:37.196408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:37.197074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:37.203329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:37.205425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:37.205425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:37.205713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:37.205997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:37.206423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:37.271476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:37.279807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4ddc64f7-7ff4-4fcd-ab17-8f26f0524f05 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087503 Aug 23 22:57:37.280384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1383/2735] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:37 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:38.038811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:38.039413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:38.045808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:38.046291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:38.046723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:38.047406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:38.047887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:38.049132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:38.184627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:38.192714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8762eb65-91d8-4e6e-997f-5c239145ee6d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157804 Aug 23 22:57:38.193301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1353/2736] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:38 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:38.300819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:38.301461 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:38.307815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:38.308289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:38.308717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:38.309427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:38.309872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:38.310288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:38.372941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:38.381660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8c698a9c-9cb4-4eef-923b-02ca9df64a1f tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084665 Aug 23 22:57:38.382262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1384/2737] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:38 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:39.214602 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:39.215223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:39.222581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:39.223115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:39.223558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:39.224248 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:39.224704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:39.225156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:39.354984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:39.364728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-61761e79-d79a-4aa4-9b43-86a9e7d5b5a9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153113 Aug 23 22:57:39.365548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1354/2738] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:39.402811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:39.403426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:39.410436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:39.410911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:39.411380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:39.412057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:39.412497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:39.412912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:39.474096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:39.482447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-23ab5d04-cf11-4b99-b195-723aab5b37b1 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083591 Aug 23 22:57:39.483018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1385/2739] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:39 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:40.386071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:40.386677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:40.393096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:40.393588 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:40.394066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:40.394762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:40.395215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:40.395640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:40.504212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:40.504826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:40.511497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:40.511982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:40.512420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:40.513141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:40.513593 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:40.514012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:40.530053 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:40.539786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5d231a79-ed74-4eac-86e4-a84b4d9211ac tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157534 Aug 23 22:57:40.556453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1355/2740] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:40.579607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:40.587776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eabb4f49-c3e9-4071-9c3e-a47ddf70d172 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088060 Aug 23 22:57:40.588785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1386/2741] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:40 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:41.571310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:41.571965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:41.578605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:41.579087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:41.580137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:41.580852 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:41.581360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:41.581794 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:41.609288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:41.609921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:41.616458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:41.616953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:41.617432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:41.618131 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:41.618582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:41.619008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:41.686622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:41.696302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e30ae96e-35fb-417e-9521-5b6dde4c116b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090889 Aug 23 22:57:41.696940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1387/2742] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:41 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:41.712005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:41.720633 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-da4dea4a-c70c-4287-beb7-48203f991088 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153341 Aug 23 22:57:41.721229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1356/2743] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:42.717919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:42.718538 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:42.725826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:42.726309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:42.726749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:42.727440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:42.727925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:42.728373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:42.742075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:42.742692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:42.744979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=52 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:42.749628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:42.750110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:42.750545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:42.751260 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:42.751713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:42.752142 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:42.793766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:42.802439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d59c20a9-e823-4fd5-b1c0-0d60d3aba608 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088393 Aug 23 22:57:42.803020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1388/2744] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:42 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:42.886927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:42.895873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f5ea27cd-05d5-40d9-a7d6-2288953a6785 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157675 Aug 23 22:57:42.896441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1357/2745] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:43.823531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:43.824100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:43.830667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:43.831162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:43.831614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:43.832335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:43.832817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:43.833251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:43.895471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:43.903892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d4088146-add6-406e-9b6d-827b6c31e176 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084368 Aug 23 22:57:43.904470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1389/2746] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:43 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:43.917816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:43.918429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:43.925774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:43.926289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:43.926717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:43.927397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:43.927843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:43.928259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:44.055640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:44.064026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-039a8fd3-66d0-40f8-ac3b-486b2dd8866f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149976 Aug 23 22:57:44.064807 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1358/2747] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:44.926103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:44.926664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:44.933309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:44.933868 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:44.934310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:44.935000 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:44.935456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:44.935883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:44.997817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:45.006929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0148a234-b3bd-4d60-bb78-d9e197593c90 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.084856 Aug 23 22:57:45.007495 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1390/2748] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:44 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:45.086463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:45.087068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:45.093558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:45.094043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:45.094479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:45.095159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:45.095668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:45.096241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:45.228332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:45.237004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8a5c8341-3d0a-441d-a9e1-7108553169c8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153992 Aug 23 22:57:45.237765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1359/2749] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:45 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:46.028702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:46.029337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:46.036775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:46.037287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:46.037724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:46.038403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:46.038853 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:46.039272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:46.104683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:46.113065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8582fbb1-edc5-4d70-b2ae-b6708dc6bec4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088345 Aug 23 22:57:46.113636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1391/2750] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:46 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:46.257107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:46.257711 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:46.264253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:46.264753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:46.265214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:46.265940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:46.266336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:46.266753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:46.400377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:46.409148 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a5274370-67e7-456b-a6e8-461d89d9c8d8 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155861 Aug 23 22:57:46.409719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1360/2751] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:47.133523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:47.134124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:47.140566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:47.141085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:47.141530 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:47.142215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:47.142852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:47.143447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:47.146056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:47.211749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:47.219954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-31e64ce4-8211-4286-85a5-a1f20025f19a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090292 Aug 23 22:57:47.221065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1392/2752] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:47 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:47.431361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:47.431953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:47.438728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:47.439362 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:47.439801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:47.440489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:47.440983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:47.441504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:47.458819 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:47.575320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:47.584692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2d2ee328-b9e7-4fed-8574-e8cd0dc68ca3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157454 Aug 23 22:57:47.585312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1361/2753] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:48.241727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:48.242411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:48.244636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=56 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:57:48.249604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:48.250081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:48.250539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:48.251193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:48.251712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:48.252731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:48.315940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:48.325144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1782f387-aba2-45cb-8c0f-4a4d25e7b288 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087245 Aug 23 22:57:48.325818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1393/2754] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:48 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:48.606554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:48.607273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:48.614262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:48.614745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:48.615198 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:48.615879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:48.616323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:48.616739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:48.749350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:48.758007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c9cb63f4-abb2-40ec-8998-25ca08bf561c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155422 Aug 23 22:57:48.758599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1362/2755] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:49.347473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:49.348092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:49.354948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:49.357312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:49.357312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:49.357312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:49.357312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:49.357771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:49.424431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:49.432498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-686b71ca-4b88-4d3f-9d27-ef5a291717d8 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090192 Aug 23 22:57:49.433077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1394/2756] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:49 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:49.779846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:49.780463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:49.787359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:49.787845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:49.788286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:49.788972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:49.789452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:49.789877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:49.921424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:49.930240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-80a3bcc3-03e9-4264-8a9e-030f8867f370 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154207 Aug 23 22:57:49.930824 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1363/2757] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:50.453564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:50.454174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:50.460805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:50.461320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:50.461762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:50.462443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:50.462897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:50.463322 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:50.533710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:50.543387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93c66cd3-d828-4145-a884-ff395e2607dc tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.093620 Aug 23 22:57:50.544052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1395/2758] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:50 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:50.951775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:50.952395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:50.959450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:50.959943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:50.960380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:50.961082 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:50.961538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:50.961959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:51.095231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:51.103984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a7b33214-b4ec-4031-a392-d75842bed303 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156074 Aug 23 22:57:51.104578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1364/2759] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:51.570893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:51.571506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:51.577998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:51.578509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:51.578945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:51.579632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:51.580081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:51.580502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:51.644731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:51.653479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8069d537-052d-40c1-b9a3-ff87445e8bb0 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086403 Aug 23 22:57:51.654080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1396/2760] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:51 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:52.124855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:52.125514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:52.132505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:52.133000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:52.133468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:52.134156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:52.134612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:52.135038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:52.267061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:52.276084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8b8f4dc-eba3-4963-966c-d2848dcb3ad3 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155079 Aug 23 22:57:52.276645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1365/2761] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:52 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:52.675118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:52.676308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:52.682751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:52.683231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:52.683660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:52.684333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:52.684779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:52.685258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:52.746138 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:52.754998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97b75cb0-faea-478a-a193-46a558fc7c72 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.083579 Aug 23 22:57:52.755558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1397/2762] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:52 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:53.299574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:53.300189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:53.307440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:53.307918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:53.308380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:53.309081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:53.309534 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:53.309950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:53.437946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:53.446495 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-62dfe97f-b204-4817-ad24-755d5f8b396d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150885 Aug 23 22:57:53.447069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1366/2763] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:53.776442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:53.777149 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:53.784370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:53.785653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:53.786145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:53.786854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:53.787337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:53.787774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:53.850860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:53.859334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b6aadfa6-644e-4125-9027-3d1921573337 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087285 Aug 23 22:57:53.859925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1398/2764] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:53 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:54.468629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:54.469517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:54.476381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:54.476864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:54.477325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:54.478004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:54.478448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:54.478863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:54.612140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:54.620895 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7d8c0474-e361-44d3-8fe5-a8079309bea5 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156479 Aug 23 22:57:54.621481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1367/2765] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:54.880702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:54.881399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:54.888273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:54.889922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:54.889922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:54.890163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:54.890413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:54.890841 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:54.962108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:54.971069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-03017e6d-14a3-481a-98e4-720fae0860de tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.094926 Aug 23 22:57:54.971677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1399/2766] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:54 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:57:55.390805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:57:55.391092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:57:55.642531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:55.643177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:55.649478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:55.649994 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:55.650423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:55.651095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:55.651541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:55.651961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:55.780760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:55.790425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6d30fde0-cb29-435a-a1a6-38176b64b009 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151859 Aug 23 22:57:55.790995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1368/2767] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:55.992800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:55.993444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:55.999824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:56.000313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:56.000756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:56.001486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:56.001945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:56.002370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:56.065240 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:56.073839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fbabe3d1-acc7-424b-8b53-7fec4264ff94 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.085633 Aug 23 22:57:56.074410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1400/2768] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:55 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:56.811978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:56.812515 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:56.820196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:56.820690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:56.821203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:56.821909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:56.822365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:56.822789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:56.962698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:56.971176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ece7991-524f-428d-8f39-2e616341d827 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.163483 Aug 23 22:57:56.971797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1369/2769] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:57.081631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:57:57.082966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:57:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:57:57.094305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:57.094906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:57.101435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:57.101910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:57.102336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:57.103007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:57.103448 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:57.103860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:57.168638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:57.177467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5221cca6-7e8c-4bfb-9093-009bc8e761fe tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086877 Aug 23 22:57:57.178025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1401/2770] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:57 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:57.993415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:57.994071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:58.000740 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:58.001269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:58.001712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:58.002423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:58.002882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:58.003311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:58.137199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:58.145648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c79ab4db-d65a-4d58-8daa-cc9f8ab9c73c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156770 Aug 23 22:57:58.146211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1370/2771] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:58.198162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:58.198792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:58.205134 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:58.205610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:58.206039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:58.206860 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:58.207304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:58.207719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:58.268261 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:58.276583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5973580b-217b-462d-b01e-b14f6f5fde88 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.082268 Aug 23 22:57:58.277166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1402/2772] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:58 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:59.166616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:59.167307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:59.173786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:59.174301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:59.174739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:59.175433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:59.175886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:59.176312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:59.298314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:57:59.299125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:57:59.304959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:59.305993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:59.306485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:59.306926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:59.307716 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:57:59.308197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:57:59.308624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:57:59.313117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38a76d7d-b3ef-406d-a3fd-679c52a9876e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150349 Aug 23 22:57:59.313680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1371/2773] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:57:59.375117 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:57:59.384081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1b7b3c92-3120-4da6-87e9-e61bc7bdfe4d tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.089756 Aug 23 22:57:59.384642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1403/2774] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:57:59 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:58:00.335295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:00.335886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:00.342412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:00.342904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:00.343341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:00.344043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:00.344496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:00.344918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:00.405423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:00.406020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:00.413572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:00.414065 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:00.414505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:00.415210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:00.415662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:00.416082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:00.480401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:00.483390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:00.489748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3dc27fb3-df24-4c6d-a86a-ab234a7d8e41 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.088079 Aug 23 22:58:00.490332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1404/2775] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:00 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:58:00.492442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e5f62a44-3790-4745-bbb4-3a6044d57427 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161305 Aug 23 22:58:00.493050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1372/2776] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:01.510542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:01.511210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:01.513715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:01.514679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:01.517635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:01.518116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:01.518544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:01.519831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:01.520287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:01.520702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:01.521433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:01.521921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:01.522359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:01.523050 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:01.523507 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:01.523931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:01.585813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:01.594285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11314066-f555-4565-928c-4b778be4c5bd tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.087834 Aug 23 22:58:01.594864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1405/2777] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:01 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:01.655561 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:01.664366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f149edd1-2e77-40a5-b913-7969c49fed6c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154361 Aug 23 22:58:01.664966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1373/2778] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:58:02.616405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:02.617038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:02.623180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:02.623665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:02.624366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:02.624830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:02.625323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:02.625750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:02.686827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:02.687835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:02.689661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:02.694804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:02.695366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:02.695806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:02.696488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:02.696937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:02.697415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:02.698207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1c0b8dfd-c0f9-439b-9249-7e8bb9983774 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.086454 Aug 23 22:58:02.698782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1406/2779] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:02 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:02.829872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:02.838679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-22c7d6ef-078a-4a19-b8ed-b3aee22cc5f6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156735 Aug 23 22:58:02.839237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1374/2780] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:58:03.719611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:03.720226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 6bede37e-5924-4bc2-9b2f-2a29c6e24b73] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:03.727424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:03.727912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:03.728352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:03.729062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:03.729522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:03.729946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:03.796050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:03.806044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0fdfdbff-128f-43f0-9bc3-ff2334561390 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73" status: 200 len: 1375 microversion: 2.1 time: 0.090269 Aug 23 22:58:03.806609 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1407/2781] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:03 2022] GET /compute/v2.1/servers/6bede37e-5924-4bc2-9b2f-2a29c6e24b73 => generated 1375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:03.825390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ab70859e-bc06-4002-9f59-72ca1a29f72b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '.version_select at 0x7f5ed0ed6040>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:03.859791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:03.860401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:03.867509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:03.868035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:03.868522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:03.869255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:03.869712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:03.870135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:03.905851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ab70859e-bc06-4002-9f59-72ca1a29f72b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936484238" status: 202 len: 0 microversion: 2.1 time: 0.084285 Aug 23 22:58:03.906686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1375/2782] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 22:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936484238 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:58:04.002521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:04.004828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:04.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9adc3642-c928-4694-8e1f-d3632649331c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155807 Aug 23 22:58:04.012341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1408/2783] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:03 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:58:05.034808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:05.035956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:05.042255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:05.042742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:05.044817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:05.044817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:05.044817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:05.044817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:05.179898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:05.188195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b1eeeee4-c51f-49ab-ac10-b3fbe1646ca9 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158115 Aug 23 22:58:05.188781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1376/2784] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:05 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:06.210386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:06.211036 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:06.218023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:06.218547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:06.218990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:06.219705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:06.220161 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:06.220608 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:06.353177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:06.362101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f7de2356-0577-471d-b7a3-2c873f9fc886 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156359 Aug 23 22:58:06.362597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1409/2785] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:06 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:07.387341 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:07.387907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:07.394605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:07.395227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:07.395659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:07.397064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:07.397524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:07.397946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:07.526020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:07.534604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2463d109-e954-43b0-9120-ea74c9a1c3e2 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154771 Aug 23 22:58:07.535167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1377/2786] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:07 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:08.269557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:58:08.269855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 22:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:58:08.556354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:08.557435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:08.563127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:08.563643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:08.564118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:08.564823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:08.565327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:08.565777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:08.699919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:08.708125 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c3d45881-41ac-42a8-8fc2-e43be6b158eb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156111 Aug 23 22:58:08.708690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1410/2787] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:08 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:09.730067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:09.730670 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:09.737225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:09.737714 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:09.738149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:09.738837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:09.739288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:09.739709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:09.873076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:09.881347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-49986d5d-e2ac-4adc-a91a-6ba5214cb0a1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.155588 Aug 23 22:58:09.882522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1378/2788] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:09 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:10.904167 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:10.904786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:10.912074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:10.913314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:10.913809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:10.914596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:10.915081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:10.915542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:11.044893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:11.053290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5e781e28-f998-4ca0-8cb1-7dc605fe6482 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153391 Aug 23 22:58:11.053919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1411/2789] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:10 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:12.074662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:12.075350 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:12.082286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:12.082778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:12.083220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:12.084037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:12.085180 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:12.085643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:12.091080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:12.215498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:12.223634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fc3914b1-adc0-4da7-855a-86d39b273451 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153117 Aug 23 22:58:12.224192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1379/2790] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:12 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:13.246040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:13.246701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:13.253139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:13.253617 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:13.254053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:13.254708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:13.255151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:13.255614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:13.387179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:13.395335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6279e66a-695b-4b7a-b6dc-19bac660dab1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153316 Aug 23 22:58:13.395905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1412/2791] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:13 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:14.417696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:14.418390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:14.420999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:14.425939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:14.426486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:14.426964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:14.427685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:14.428163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:14.428618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:14.561509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:14.570400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-654c8f62-f42c-4a1e-92c8-b61e04fec6fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156287 Aug 23 22:58:14.570961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1380/2792] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:14 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:15.591764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:15.592396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:15.598747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:15.599225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:15.599657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:15.600337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:15.600888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:15.601548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:15.731843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:15.739907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7f35766f-0acf-4e36-95c7-269774797acc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152016 Aug 23 22:58:15.740469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1413/2793] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:15 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:16.760320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:16.760933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:16.767470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:16.767949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:16.768374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:16.769079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:16.769529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:16.769948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:16.906594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:16.915330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ebe5c2c3-23c0-4f0c-8426-e1bcf6a18db6 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158941 Aug 23 22:58:16.915892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1381/2794] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:16 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:17.937159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:17.937719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:17.944222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:17.944706 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:17.945259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:17.945959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:17.946414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:17.946835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:18.077736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:18.086675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2f0abc6e-7669-43c0-8d4a-bb9f0074b5ef tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153415 Aug 23 22:58:18.087244 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1414/2795] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:17 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:19.108177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:19.108878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:19.115322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:19.115805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:19.116237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:19.116919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:19.117401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:19.117818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:19.247761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:19.256052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-95590f9d-cc08-4343-a9ec-6bcc566dff73 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151729 Aug 23 22:58:19.256623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1382/2796] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:19 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:20.278440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:20.279559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:20.281586 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=44 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:20.286314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:20.286750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:20.287179 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:20.287903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:20.288349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:20.288765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:20.422912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:20.431100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-02d88551-a09f-4fa4-b0c3-10ba205b8cca tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156964 Aug 23 22:58:20.431669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1415/2797] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:20 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:21.452056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:21.452750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:21.459309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:21.459786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:21.460216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:21.460937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:21.461412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:21.461833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:21.596985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:21.606256 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f676688b-b576-4746-860f-aced75e6a05a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158168 Aug 23 22:58:21.606823 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1383/2798] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:21 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:22.627464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:22.628075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:22.634747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:22.635332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:22.635774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:22.636456 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:22.636903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:22.637355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:22.771479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:22.780271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aed8fbe0-e78b-4672-8e91-b9cd05681ef7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156727 Aug 23 22:58:22.781136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1416/2799] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:22 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:23.801723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:23.802345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:23.809504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:23.809928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:23.810370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:23.811057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:23.811509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:23.811930 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:23.942708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:23.951386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d7f1ba41-e7c3-4519-abc4-70a659e2811c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153503 Aug 23 22:58:23.951956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1384/2800] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:23 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:24.974680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:24.975314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:24.982184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:24.982672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:24.983114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:24.983812 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:24.984267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:24.984691 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:25.129972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:25.138625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e40967e3-b5e9-4ecd-9351-12b9749968fb tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.167984 Aug 23 22:58:25.139208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1417/2801] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:24 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:26.160195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:26.160816 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:26.168371 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:26.168863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:26.169332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:26.170031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:26.170488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:26.170913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:26.305169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:26.314425 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7a781301-4051-4aa7-bbd8-be333d7dbd38 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158279 Aug 23 22:58:26.315014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1385/2802] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:26 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:27.336182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:27.336801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:27.344063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:27.344548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:27.345050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:27.345780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:27.346233 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:27.346669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:27.477085 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:27.485881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-101eb16c-08f2-451c-8250-1f5624480f22 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153661 Aug 23 22:58:27.486467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1418/2803] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:27 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:28.507004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:28.507656 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:28.514733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:28.515211 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:28.515650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:28.516337 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:28.516795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:28.517252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:28.644832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:28.653653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9ea54758-6bf6-43d9-a532-0841992a0be0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150579 Aug 23 22:58:28.654217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1386/2804] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:28 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:29.676056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:29.676669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:29.684394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:29.684878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:29.685406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:29.686135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:29.686652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:29.687104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:29.820949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:29.829382 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-606b3091-9cd5-40aa-bdb9-88b8d4a41b8f tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157166 Aug 23 22:58:29.829950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1419/2805] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:29 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:30.850709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:30.851287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:30.858514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:30.859000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:30.859531 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:30.860285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:30.860754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:30.861218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:30.989702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:30.998570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-624fcb10-5808-4aa2-8d47-52381bbd1868 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152210 Aug 23 22:58:30.999194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1387/2806] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:30 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:32.019929 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:32.020657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:32.030564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:32.031045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:32.031480 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:32.032308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:32.032871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:32.033333 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:32.165562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:32.175779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-60bc54f9-b0a3-4b06-817c-9af626162a17 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159739 Aug 23 22:58:32.176493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1420/2807] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:32 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:33.198339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:33.198938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:33.205995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:33.206481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:33.206918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:33.207618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:33.208077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:33.208505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:33.349721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:33.354885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dd644b66-93cd-4b58-8a1f-a470d0b14821 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161098 Aug 23 22:58:33.355449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1388/2808] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:33 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:34.375406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:34.376012 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:34.382702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:34.383177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:34.383680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:34.384944 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:34.385421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:34.385840 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:34.520083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:34.529241 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a6755c5-a78a-4d8a-be59-0b9300898d62 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157701 Aug 23 22:58:34.529816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1421/2809] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:34 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:35.087909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:58:35.088175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:58:35.551614 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:35.552242 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:35.558478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:35.558971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:35.559411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:35.560105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:35.560575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:35.560992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:35.690488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:35.700265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b8a3daca-26d1-4402-8102-00b7528bed89 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151928 Aug 23 22:58:35.700426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1389/2810] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:35 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:36.722689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:36.723383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:36.729542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:36.730019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:36.730452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:36.731128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:36.731600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:36.732015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:36.734597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=80 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:36.863420 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:36.872726 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f395b0ba-aec3-44b9-877f-664a3c76c489 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153872 Aug 23 22:58:36.873330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1422/2811] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:36 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:37.894020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:37.894599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:37.901182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:37.901666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:37.902097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:37.902772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:37.903220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:37.903639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:38.034289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:38.043346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e0b93752-7fe1-4683-ad17-95a56180de11 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153231 Aug 23 22:58:38.043935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1390/2812] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:37 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:39.064628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:39.065284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:39.071833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:39.072307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:39.072734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:39.073445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:39.073891 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:39.074407 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:39.202519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:39.210825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b44d97bd-bc65-411e-8b02-6276e7715e8a tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.150044 Aug 23 22:58:39.211387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1423/2813] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:39 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:40.232407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:40.233092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:40.239456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:40.239939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:40.240373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:40.241072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:40.241523 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:40.241940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:40.369851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:40.377846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c327e031-73f0-45f3-985d-b8c3b3b61e5e tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149450 Aug 23 22:58:40.378406 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1391/2814] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:40 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:41.400008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:41.400669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:41.407365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:41.407851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:41.408292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:41.408973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:41.409455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:41.409877 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:41.546450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:41.554779 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b344876a-a055-43cb-892b-2184fe2b4d05 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158988 Aug 23 22:58:41.555455 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1424/2815] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:41 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:42.575886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:42.576502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:42.582891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:42.583366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:42.583795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:42.584466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:42.584911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:42.585354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:42.589227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:42.716920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:42.725074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5115a009-91d2-4c80-945b-79a2d673d155 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153042 Aug 23 22:58:42.725638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1392/2816] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:42 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:43.747197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:43.747809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:43.754184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:43.754674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:43.755113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:43.755798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:43.756250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:43.756673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:43.883567 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:43.891798 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-af54380f-e1b3-41a5-8ec5-3b05bbe36cc1 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.149188 Aug 23 22:58:43.892368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1425/2817] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:43 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:44.913938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:44.914510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:44.917380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=26 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:44.922155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:44.922639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:44.923076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:44.923762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:44.924250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:44.924726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:45.064917 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:45.073300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-93fa47ba-2d1e-45e5-afa8-25fa153cae8c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.163307 Aug 23 22:58:45.088524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1393/2818] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:44 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:46.094808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:46.095411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:46.101897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:46.102369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:46.102793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:46.103984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:46.104508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:46.104926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:46.236010 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:46.244974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfdb474f-b837-4692-88cc-657592cf569d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153322 Aug 23 22:58:46.245514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1426/2819] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:46 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:47.267839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:47.268439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:47.274952 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:47.275971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:47.276415 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:47.277115 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:47.277562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:47.277976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:47.407421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:47.415704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c10e0168-d7b0-4001-8b4e-41eabf83eac7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151772 Aug 23 22:58:47.417285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1394/2820] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:47 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:48.438450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:48.439148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:48.446597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:48.447252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:48.447953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:48.448736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:48.449289 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:48.449780 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:48.582821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:48.592301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71f75278-ca33-45cf-9c80-b6ed4d60fc7c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158314 Aug 23 22:58:48.592979 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1427/2821] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:48 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:49.614754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:49.615383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:49.622262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:49.622744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:49.623169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:49.623844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:49.624289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:49.624782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:49.763600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:49.771875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-49c17ae9-c53e-463a-af46-f725ef887ea0 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161422 Aug 23 22:58:49.772446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1395/2822] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:49 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:50.794765 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:50.795384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:50.797709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=26 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:58:50.802666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:50.803145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:50.803573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:50.804315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:50.804766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:50.805215 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:50.939303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:50.948130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0f445703-f3f6-46f9-9b77-8c60e9aaf423 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158248 Aug 23 22:58:50.948707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1428/2823] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:50 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:51.969859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:51.970473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:51.976905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:51.977419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:51.977856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:51.979541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:51.980002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:51.980433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:52.109158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:52.117767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f80d955e-a34b-4a78-ad03-39f3c5ec515d tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.151661 Aug 23 22:58:52.123762 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1396/2824] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:51 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:53.139127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:53.139746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:53.146272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:53.146795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:53.147235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:53.147922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:53.148375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:53.148801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:53.279832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:53.287984 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-cfedfa83-e948-48a5-a6ff-f95fce1eb65c tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.152864 Aug 23 22:58:53.288552 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1429/2825] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:53 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:54.310229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:54.310841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:54.317577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:54.318058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:54.318487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:54.319172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:54.319616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:54.320033 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:54.453624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:54.462160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a2fc7bad-7c9b-429a-a943-00f5f4444e51 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.156219 Aug 23 22:58:54.462821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1397/2826] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:54 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:55.485203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:55.486015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:55.494180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:55.494665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:55.495130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:55.495817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:55.496265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:55.496684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:55.630796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:55.639670 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71143fdf-5d86-44e3-91b2-0eaa1077da36 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.159749 Aug 23 22:58:55.645182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1430/2827] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:55 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:56.661765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:56.662320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:56.669078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:56.669569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:56.670026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:56.670729 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:56.671200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:56.671627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:56.805985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:56.816924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2eff4471-438a-42a4-99b7-998ce0f78af7 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.158926 Aug 23 22:58:56.817767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1398/2828] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:56 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:57.844661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:57.845358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:57.851664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:57.852146 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:57.852574 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:57.853318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:57.854693 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:57.855110 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:57.993755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:58.002262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9c9ab338-23d4-405a-859f-fc2c4793dbc4 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.161550 Aug 23 22:58:58.002833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1431/2829] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:57 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:58:59.023287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:58:59.023902 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:58:59.031808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:59.032296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:59.032728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:59.033520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:58:59.033977 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:58:59.034401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:58:59.168623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:58:59.176830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b10f2f0c-d1a7-4e49-af97-ed80da4fe8bc tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.157464 Aug 23 22:58:59.177438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1399/2830] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:58:59 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:59:00.198543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:59:00.199150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:59:00.205600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:00.206086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:00.206519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:00.207248 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:00.207703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:00.208127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:00.340715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:59:00.349035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e3d4afd7-5c11-4332-a1df-ecf0d2dbd265 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.154691 Aug 23 22:59:00.349603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1432/2831] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:59:00 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:59:01.371165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:59:01.371773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:59:01.378345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:01.378836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:01.379287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:01.379979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:01.380437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:01.380861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:01.512153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:59:01.520418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c647c3e1-08ef-4f68-9001-fb8dd1c1fd50 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153858 Aug 23 22:59:01.520983 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1400/2832] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:59:01 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:59:02.542414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:59:02.543213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] [instance: 2cec364e-1e66-4f45-a083-ea4e54b53913] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:59:02.549721 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:02.550207 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:02.550642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:02.551329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:59:02.551810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:59:02.552236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:59:02.682687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692cc40ea1fe47a9904f1370a8d9ba2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754172385f004ede86566e52cddf1d47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:59:02.691393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c5bdf555-6115-4056-a92d-c2c82b148544 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913" status: 200 len: 1599 microversion: 2.1 time: 0.153009 Aug 23 22:59:02.691990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1433/2833] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 22:59:02 2022] GET /compute/v2.1/servers/2cec364e-1e66-4f45-a083-ea4e54b53913 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:59:02.712121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6a388f17-7a86-4ce9-9eb1-d7cfce0bf950 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] Calling method '.version_select at 0x7f5ed0ce49d0>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:59:02.840288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6a388f17-7a86-4ce9-9eb1-d7cfce0bf950 tempest-TestMinimumBasicScenario-1100080005 tempest-TestMinimumBasicScenario-1100080005-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1934368991" status: 202 len: 0 microversion: 2.1 time: 0.131889 Aug 23 22:59:02.840871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1401/2834] 10.222.0.73 () {58 vars in 1272 bytes} [Tue Aug 23 22:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1934368991 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:59:33.238422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:59:33.239046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 22:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:00:07.725808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=11 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:00:07.727107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=71 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:00:07.731182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:00:07.731690 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:00:07.738599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:07.741119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:07.741119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:07.741119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:07.741119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:07.741769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:07.756505 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af HTTP/1.1 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:00:07.758817 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:07.760506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '182af6e4-420a-41c2-90ea-a10069ce20af'} Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:00:07.999695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.001734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.002829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:00:08.002829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e3974f97-fb07-4a95-a469-c639e8520d7b tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 404 len: 111 microversion: 2.20 time: 0.036277 Aug 23 23:00:08.002829 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1434/2835] 10.222.0.73 () {60 vars in 1280 bytes} [Tue Aug 23 23:00:07 2022] DELETE /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 23:00:08.003140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=53 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:00:08.003140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:00:08.003534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:00:08.003534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:00:08.003672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:00:08.003672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: 182af6e4-420a-41c2-90ea-a10069ce20af] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:00:08.003795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.003795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.003795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.003795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.004037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.004105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.004181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.004251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.004251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.004251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.004251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.004551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.004622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.004690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 HTTP/1.1 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:00:08.004758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.006118 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'bb8f6ad2-07f8-4f77-81d2-70e697b1e275'} Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:00:08.007114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.008695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af HTTP/1.1 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:00:08.009692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.010892 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '182af6e4-420a-41c2-90ea-a10069ce20af'} Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:00:08.011765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. Aug 23 23:00:08.012826 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.013832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:00:08.013942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance 182af6e4-420a-41c2-90ea-a10069ce20af could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:00:08.014018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4eb9c008-d4c3-4d9c-8a0d-6625668efa9b tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 404 len: 111 microversion: 2.1 time: 0.033943 Aug 23 23:00:08.014177 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4486445d-5f7a-4725-9c7b-6cd5a1d92bf1 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af" status: 404 len: 111 microversion: 2.20 time: 0.036123 Aug 23 23:00:08.014253 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1435/2836] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:00:07 2022] DELETE /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 23:00:08.014323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1402/2837] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 23:00:07 2022] GET /compute/v2.1/servers/182af6e4-420a-41c2-90ea-a10069ce20af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 23:00:08.014392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:00:08.014392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] [instance: bb8f6ad2-07f8-4f77-81d2-70e697b1e275] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:00:08.014392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.014392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.014703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.014703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:00:08.014703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:00:08.014703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] HTTP exception thrown: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Request method failure captured: Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 HTTP/1.1 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUwv3Nov6HOE1g_TyoNvJpp-7jmQiucf27_Ce89g7Hiylhw1UTTweXXIMDq1faB8zyMd-NhyfvHGfVGkscvVgM95RCSSuNfVeRpjT_E_6S3k30FklidSEAhDsVajkrkixFh5D2euR7QS32ZGu8_haQr5AUarOdem6Eq79nl5DQX5-s Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:00:08.014952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0430b3e5fcd0415fb2c658443d8f6bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0430b3e5fcd0415fb2c658443d8f6bf1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 0430b3e5fcd0415fb2c658443d8f6bf1 Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1883503509 Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 2ca578d6a1374212a4f1476335c641b3 Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeTestJSON-1883503509-project Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.016283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'bb8f6ad2-07f8-4f77-81d2-70e697b1e275'} Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:00:08.017239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. Aug 23 23:00:08.018445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:00:08.019393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] Returning 404 to user: Instance bb8f6ad2-07f8-4f77-81d2-70e697b1e275 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:00:08.019393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4196ef7e-4cf4-43f4-9b72-557b58753c59 tempest-AttachVolumeTestJSON-1883503509 tempest-AttachVolumeTestJSON-1883503509-project] 10.222.0.73 "GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275" status: 404 len: 111 microversion: 2.1 time: 0.053815 Aug 23 23:00:08.019393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1436/2838] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:00:07 2022] GET /compute/v2.1/servers/bb8f6ad2-07f8-4f77-81d2-70e697b1e275 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:01:04.700966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cec364e-1e66-4f45-a083-ea4e54b53913", "name": "network-vif-deleted", "tag": "85c5326d-185d-4f64-b484-2d2f97361b40"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:01:04.711712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:01:04.712280 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:01:04.712712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:01:04.723837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] Creating event network-vif-deleted:85c5326d-185d-4f64-b484-2d2f97361b40 for instance 2cec364e-1e66-4f45-a083-ea4e54b53913 on hv-cinder-84254 Aug 23 23:01:04.730327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-dcbdf690-5636-4195-be99-379ee7cb632b req-7535de48-364e-4ef2-b6a9-d69b45b84189 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156924 Aug 23 23:01:04.730928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1403/2839] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:01:15.399536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:01:15.400292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:01:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:01:17.090523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:01:17.091048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:01:55.095878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:01:55.130370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:01:58.118083 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:01:58.118659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:02:53.246755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:02:53.247422 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:03:08.279557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:03:08.280124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:04:35.407429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:04:35.408168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:04:37.098622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:04:37.099243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:04:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:05:15.104737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:05:15.105434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:05:18.125777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:05:18.126331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:06:13.255958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:06:13.256804 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:06:28.287683 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:06:28.288377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:06:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:07:05.718518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3842731b-e783-4419-8b17-ab775e165e14] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 23:07:05.719323 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.720137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.724332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:05.724982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:05.731230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:05.732274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:05.732945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:05.733685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:05.734153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:05.734579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:05.749950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc HTTP/1.1 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:07:05.751573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.753908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'e4822c04-cfe2-4f63-b2db-42c5011791cc'} Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:07:05.754696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.755970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.757066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:07:05.757066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bf72bf1b-4c4e-415e-ab23-b947a31e7af4 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 404 len: 111 microversion: 2.20 time: 0.036854 Aug 23 23:07:05.757066 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1437/2840] 10.222.0.73 () {60 vars in 1280 bytes} [Tue Aug 23 23:07:05 2022] DELETE /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 23:07:05.762391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 23 23:07:05.772404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.772404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.772404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:05.772404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] [instance: e4822c04-cfe2-4f63-b2db-42c5011791cc] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:05.776528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:05.777037 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:05.777584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:05.778289 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:05.779674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:05.780107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:05.794636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] HTTP exception thrown: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Request method failure captured: Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc HTTP/1.1 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBVXBbHx0YUJKIww_ZwPPnKPy6W8G2eUoWAJ6GAnV6uGDPxZ7zDNZd3BaVG4y3LG9rkLJZuR64cDAGRrHLlKSK45kLFPZk9PpfhvhZFahcwT4ip1QzzjJGXddBwnb-_gfWJF1TgjNCUw_3FwSXw76p3DQvlSAxbeQtQ0F_fBhh-WXO_s Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:07:05.796459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02af2d33ca74bd08365dfc34a6fa77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02af2d33ca74bd08365dfc34a6fa77a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: b02af2d33ca74bd08365dfc34a6fa77a Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1312268379 Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 3eda1fca08b24727929b63318fd6f13e Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1312268379-project Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.798477 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'e4822c04-cfe2-4f63-b2db-42c5011791cc'} Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:07:05.799222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. Aug 23 23:07:05.800281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:07:05.801932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] Returning 404 to user: Instance e4822c04-cfe2-4f63-b2db-42c5011791cc could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:07:05.801932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b3065177-a52c-49b0-810d-e07b3845af54 tempest-AttachVolumeShelveTestJSON-1312268379 tempest-AttachVolumeShelveTestJSON-1312268379-project] 10.222.0.73 "GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc" status: 404 len: 111 microversion: 2.20 time: 0.037998 Aug 23 23:07:05.801932 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1404/2841] 10.222.0.73 () {60 vars in 1277 bytes} [Tue Aug 23 23:07:05 2022] GET /compute/v2.1/servers/e4822c04-cfe2-4f63-b2db-42c5011791cc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 23:07:19.095808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] [3842731b-e783-4419-8b17-ab775e165e14] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56496. Aug 23 23:07:19.296657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3813705b-7121-451c-8caa-bdabe078ff9e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: .version_select at 0x7f5ed0ec90d0>, body: {"keypair": {"name": "tempest-keypair-1981624585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRmCZR9ojC5hhDjAf0Y6la1bxiUVMfrf937MkxRWl4MQ/W97NQMNWdab/KQtUQHU9O58t1VawBhYkb8i0fIRyHxfP7CxykKJ+KBTd8Cz2N9rhrAKaMV50XXmC7iOrYYUA=="}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:07:19.314562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-3813705b-7121-451c-8caa-bdabe078ff9e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:07:19.320148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-3813705b-7121-451c-8caa-bdabe078ff9e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:07:19.452183 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3813705b-7121-451c-8caa-bdabe078ff9e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.374543 Aug 23 23:07:19.452428 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1438/2842] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:07:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:07:22.174199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2137621273", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974386b3-3c24-4bb8-8a00-3bab468a71cb"}], "security_groups": [{"name": "tempest-securitygroup--1485804067"}], "key_name": "tempest-keypair-1981624585", "user_data": "}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:07:22.205158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56510. Aug 23 23:07:22.481759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] validate_networks() for [('974386b3-3c24-4bb8-8a00-3bab468a71cb', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:07:23.116914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:07:23.117298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:07:23.117967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:07:23.118377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:07:23.118787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:07:23.129397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:23.129840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:23.134776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:23.135753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:23.136219 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:23.136648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:23.157654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:07:23.162510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:07:23.177472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:07:23.180828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:07:23.351880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b0e07612-753e-47a0-a107-27455a77f111 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.183321 Aug 23 23:07:23.352547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1405/2843] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:07:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:07:23.381193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e135e373-3dfa-450b-a62e-aaa2a4064cf1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:23.382844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e135e373-3dfa-450b-a62e-aaa2a4064cf1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:23.556009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e135e373-3dfa-450b-a62e-aaa2a4064cf1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:23.570345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e135e373-3dfa-450b-a62e-aaa2a4064cf1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1242 microversion: 2.1 time: 0.205137 Aug 23 23:07:23.571018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1439/2844] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:23 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:24.601655 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4251af97-549d-4f5c-8e29-98692c6439f9 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:24.602710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4251af97-549d-4f5c-8e29-98692c6439f9 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:24.695841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4251af97-549d-4f5c-8e29-98692c6439f9 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:24.705748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4251af97-549d-4f5c-8e29-98692c6439f9 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1242 microversion: 2.1 time: 0.109226 Aug 23 23:07:24.706615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1406/2845] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:24 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:25.731079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:25.731689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:25.739433 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:25.739922 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:25.740363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:25.741090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:25.741547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:25.741966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:25.815910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:25.830059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-11a1b178-b958-4b02-b5f2-75d26b651b63 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1294 microversion: 2.1 time: 0.102525 Aug 23 23:07:25.835653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1440/2846] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:25 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:26.855126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:26.857899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:26.871007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:26.871635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:26.872639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:26.873427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:26.874702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:26.875238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:26.946611 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:26.960014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-dea84bd2-1309-40f0-82ea-f79c7cd2b34b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1300 microversion: 2.1 time: 0.111418 Aug 23 23:07:26.962643 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1407/2847] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:26 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:27.986329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:27.994368 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:27.995026 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:27.995625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:27.996158 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:27.996980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:27.997566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:27.998075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:28.180852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:28.190386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-04f50647-4821-4615-bed0-ec2c559caf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.208508 Aug 23 23:07:28.190977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1441/2848] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:27 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:28.751331 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa78a5b-a84b-4b0f-895f-73bba0ed5810", "tag": "b4dfe160-d37a-47b1-976f-4675a4218e58"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:07:28.761612 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:28.762094 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:28.762525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:28.779194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] Creating event network-changed:b4dfe160-d37a-47b1-976f-4675a4218e58 for instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 on hv-cinder-84254 Aug 23 23:07:28.788398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-def26255-9977-4663-b961-3b3e923fd1a4 req-a3b4315d-d84d-44fc-aeac-e0b9d7746995 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123482 Aug 23 23:07:28.789178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1408/2849] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:07:29.228062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:29.229387 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:29.240972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:29.241657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:29.242182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:29.243017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:29.243824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:29.244440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:29.411587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:29.419931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dfe30f4d-0645-4cd0-b4f7-197ed72a92d3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.195732 Aug 23 23:07:29.421844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1442/2850] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:29 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:30.443629 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:30.444335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:30.450761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:30.451253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:30.452181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:30.453292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:30.453758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:30.454185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:30.601733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:30.610631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2d0da972-f21e-4220-b53d-13cdffbb368f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.171716 Aug 23 23:07:30.611217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1409/2851] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:30 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:31.633329 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:31.634741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:31.645038 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:31.645536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:31.646080 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:31.647013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:31.647475 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:31.647921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:31.953759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:31.968189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-036269b7-9562-49fc-9a53-0f409d17864d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.339463 Aug 23 23:07:31.969564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1443/2852] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:31 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:33.007815 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:33.008878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:33.020379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:33.020955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:33.021482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:33.022484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:33.022995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:33.023464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:33.145241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.199987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:33.209328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-634b75b7-c904-45ef-8f48-9d08c4ae46aa tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.209033 Aug 23 23:07:33.209918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1410/2853] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:32 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:34.232177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:34.232772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:34.235737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.240768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:34.241862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:34.241862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:34.242395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:34.242848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:34.243271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:34.446910 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:34.455761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-adbb5382-ddba-4b48-8b5d-7ee4ede4a502 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.227720 Aug 23 23:07:34.456359 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1444/2854] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:34 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:35.477481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:35.478099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:35.480779 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=8 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.487291 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:35.487789 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:35.488230 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:35.488954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:35.489470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:35.489885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:35.653526 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:35.665622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6b36a485-2c20-4fbd-9acb-ef4854b48550 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.189434 Aug 23 23:07:35.665622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1411/2855] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:35 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:35.727539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa78a5b-a84b-4b0f-895f-73bba0ed5810", "name": "network-vif-plugged", "status": "completed", "tag": "b4dfe160-d37a-47b1-976f-4675a4218e58"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:07:35.739937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:35.740524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:35.740956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:35.754544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] Creating event network-vif-plugged:b4dfe160-d37a-47b1-976f-4675a4218e58 for instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 on hv-cinder-84254 Aug 23 23:07:35.761865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-930bbc0d-0350-4074-93c0-bf5a4ad29bd5 req-c2262197-783a-4363-97fc-5dbbdf521083 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108264 Aug 23 23:07:35.762852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1445/2856] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:07:36.684431 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:36.685156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:36.692672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:36.693207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:36.693648 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:36.694354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:36.694811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:36.695241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:36.852207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:36.862695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1b997405-39fa-4577-8c86-6c82861abf9b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.182091 Aug 23 23:07:36.863297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1412/2857] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:36 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:37.885285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:37.885967 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:37.893957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:37.894452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:37.894893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:37.895699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:37.896162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:37.896595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:38.046679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:38.054908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e4dfff8d-df32-40a4-a2ad-261b4a241329 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1368 microversion: 2.1 time: 0.174512 Aug 23 23:07:38.055502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1446/2858] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:37 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:39.078070 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:39.078685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:39.085968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:39.086522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:39.087145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:39.087947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:39.088504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:39.089045 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:39.230471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:07:39.240317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-939df78c-fdd1-4cba-ac00-f061e93346d1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1558 microversion: 2.1 time: 0.166912 Aug 23 23:07:39.240900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1413/2859] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:07:39 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:39.266007 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:07:39.266768 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:07:39.274767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:39.275377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:39.275823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:39.276555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:39.277044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:39.277479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:39.368575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2ede482-b5cd-4546-8fc8-2c608ebc8ff4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108519 Aug 23 23:07:39.369536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1447/2860] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 23:07:39 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:07:40.727996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa78a5b-a84b-4b0f-895f-73bba0ed5810", "tag": "b4dfe160-d37a-47b1-976f-4675a4218e58"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:07:40.741439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:07:40.742002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:07:40.742502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:07:40.761941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] Creating event network-changed:b4dfe160-d37a-47b1-976f-4675a4218e58 for instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 on hv-cinder-84254 Aug 23 23:07:40.771384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-c045956c-5317-4e73-8f77-06595578defe req-46fc1300-5ebb-4e30-b28c-a691cd2b5eff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149575 Aug 23 23:07:40.772694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1414/2861] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:07:57.110810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:07:57.111449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:08:36.046486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.047243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=44 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.051212 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:36.051711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:36.057719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:36.059376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:36.059376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:36.059376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:36.064481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:36.064962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:36.096825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:08:36.431074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7805e5e4-107f-4a04-971e-55d6851d23c2 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 204 len: 0 microversion: 2.1 time: 0.385869 Aug 23 23:08:36.434739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1448/2862] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:08:36 2022] DELETE /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:36.438187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.440075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=44 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.445853 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:36.446587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:36.452959 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:36.453553 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:36.453998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:36.454935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:36.455394 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:36.455870 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:36.603374 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:36.612882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-302003b8-0ade-4b56-a932-6a7512b8c6f7 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.176468 Aug 23 23:08:36.613500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1415/2863] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:36 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:37.636361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:37.637770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:37.647849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:37.648542 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:37.649165 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:37.650785 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:37.651751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:37.653625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:37.829174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:37.838583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f83ed83c-7c00-4331-bda1-da9dd43f2c1b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.207491 Aug 23 23:08:37.839152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1449/2864] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:37 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:38.134043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:08:38.134557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:08:38.860171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:38.861518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:38.868964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:38.869488 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:38.869928 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:38.870665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:38.871124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:38.871628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:39.029591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:39.037828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b4f32c10-ea45-4521-b134-e379a880fc48 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.181530 Aug 23 23:08:39.038404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1416/2865] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:38 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:40.060938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:40.061580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:40.068776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:40.069303 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:40.069744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:40.070439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:40.070892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:40.071316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:40.258162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:40.266789 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a2a9701f-b6c1-47b2-afb9-990e38fe936a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.209354 Aug 23 23:08:40.267815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1450/2866] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:40 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:40.305700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f94ec-9724-4f7a-82e3-68d1713bb26c", "name": "network-vif-unplugged", "status": "completed", "tag": "48cfdc51-223a-410b-b73a-cece1286e117"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:08:40.317891 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:40.318370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:40.318802 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:40.330407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] Creating event network-vif-unplugged:48cfdc51-223a-410b-b73a-cece1286e117 for instance ff6f94ec-9724-4f7a-82e3-68d1713bb26c on hv-cinder-84254 Aug 23 23:08:40.335562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-abea9c89-b888-425b-998a-beeb011cdf31 req-5d54ff86-8efd-4698-809b-2105f7895b6c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034046 Aug 23 23:08:40.336345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1417/2867] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:08:41.287989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:41.289352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:41.295667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:41.296416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:41.296857 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:41.297592 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:41.298063 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:41.298797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:41.514705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6f94ec-9724-4f7a-82e3-68d1713bb26c", "name": "network-vif-deleted", "tag": "48cfdc51-223a-410b-b73a-cece1286e117"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:08:41.524457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:41.524944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:41.525730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:41.537486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] Creating event network-vif-deleted:48cfdc51-223a-410b-b73a-cece1286e117 for instance ff6f94ec-9724-4f7a-82e3-68d1713bb26c on hv-cinder-84254 Aug 23 23:08:41.542647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-a572e34f-ec43-491e-aaae-8c6ba1a09da6 req-d14f7ccf-5f3e-440c-b1ce-f39dcc028846 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Aug 23 23:08:41.543186 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1418/2868] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:08:41.558178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:41.566019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a1dcea61-c4b8-4821-ba5a-00dd0b082614 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.281936 Aug 23 23:08:41.566688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1451/2869] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:41 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:42.593306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:42.595060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:42.602215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:42.603013 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:42.603684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:42.604591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:42.605047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:42.606101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:42.747901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:42.755979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1ef2ca6e-17aa-4712-a458-f1039659362b tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1508 microversion: 2.1 time: 0.167736 Aug 23 23:08:42.756555 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1419/2870] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:42 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:43.557895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5efd28-1582-46ac-b8b3-5a2c48232b38", "name": "network-vif-deleted", "tag": "5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:08:43.568395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:43.568883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:43.569351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:43.580747 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] Creating event network-vif-deleted:5cf2dbc7-6648-4a0a-b19b-7f7b4fb5141d for instance be5efd28-1582-46ac-b8b3-5a2c48232b38 on hv-cinder-84254 Aug 23 23:08:43.585712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-d4ebab53-a8d4-455d-9b86-a70f25deaeb4 req-a364b9ae-c457-4018-bc08-a4f5eb364471 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Aug 23 23:08:43.586317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1452/2871] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:08:43.778416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:43.779034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:43.785760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:43.786255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:43.786705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:43.787404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:43.787866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:43.788307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:43.819763 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:43.820250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:43.820691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:43.821216 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'fault' on Instance uuid be5efd28-1582-46ac-b8b3-5a2c48232b38 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:08:43.863365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:43.870958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9c506f8c-9326-41ff-b446-6ee464ab2855 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 200 len: 1312 microversion: 2.1 time: 0.096643 Aug 23 23:08:43.871525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1420/2872] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:43 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:44.892771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:44.893597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: be5efd28-1582-46ac-b8b3-5a2c48232b38] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:44.900663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:44.901208 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:44.901650 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:44.902414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:44.902900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:44.903319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:44.917658 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] HTTP exception thrown: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Request method failure captured: Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 HTTP/1.1 Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUyoQVblB7pqZQfITadlzM1ri-o-yBZZnpHOwSBS14LZJtwpameZki1LHLRWS_RiuqONW5kqzyPOZXWfmAt082oZI7JQHcoKgokNcz47aJev2t2uXyIJKXsDRZn8m0PFUzDfA_pK2KUA6i4isLigyUO14m7FiuCNBjTB_ozFXTzxuc Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:08:44.919389 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4f9539894f147e0912a72a1855d31bc", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: ebbf49534a8f41109f51637307270016 Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. Aug 23 23:08:44.920723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'be5efd28-1582-46ac-b8b3-5a2c48232b38'} Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:08:44.921844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. Aug 23 23:08:44.923070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:44.924653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Returning 404 to user: Instance be5efd28-1582-46ac-b8b3-5a2c48232b38 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:08:44.924653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-082358d4-35b4-464f-b78b-a6039a792ecf tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38" status: 404 len: 111 microversion: 2.1 time: 0.032770 Aug 23 23:08:44.925612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1453/2873] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:44 2022] GET /compute/v2.1/servers/be5efd28-1582-46ac-b8b3-5a2c48232b38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:08:44.930396 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:44.931424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:44.938400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:44.939662 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:44.940578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:44.941536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:44.942195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:44.942835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:44.974620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:08:45.305473 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa83499e-9d57-4be6-bade-31ecc6f23630 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 204 len: 0 microversion: 2.1 time: 0.378545 Aug 23 23:08:45.307929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1421/2874] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:08:44 2022] DELETE /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:45.314899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:45.315755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:45.321815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:45.322308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:45.322745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:45.323443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:45.323893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:45.324317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:45.473892 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:45.481523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-122182bd-ec5e-4d90-ad64-a88937e7ba64 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.170687 Aug 23 23:08:45.482094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1454/2875] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:45 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:46.504649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:46.505278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:46.512797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:46.513405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:46.514165 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:46.515076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:46.515737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:46.516325 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:46.657825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:46.666880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-13e49a55-9a7c-43e2-8428-986572776e1a tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1523 microversion: 2.1 time: 0.167358 Aug 23 23:08:46.667448 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1422/2876] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:46 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:46.772587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba92e33-0332-41e6-8ae0-edb3db94d4e6", "name": "network-vif-deleted", "tag": "b80c9e2b-7745-482f-981d-a9d71d3f76ad"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:08:46.782462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:46.783027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:46.783458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:46.794803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] Creating event network-vif-deleted:b80c9e2b-7745-482f-981d-a9d71d3f76ad for instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 on hv-cinder-84254 Aug 23 23:08:46.800226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-2ddfbad6-62b4-477d-84ee-f8b947c11329 req-a5af9853-4210-4771-be0a-ee0f0f314985 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Aug 23 23:08:46.802181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1455/2877] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:08:47.688173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:47.688935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:47.697867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:47.698699 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:47.699220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:47.699985 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:47.700578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:47.701155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:47.733659 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:47.734444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:47.735078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:47.735832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lazy-loading 'fault' on Instance uuid 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:08:47.784009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf49534a8f41109f51637307270016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f9539894f147e0912a72a1855d31bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:08:47.791869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-66224bba-b9aa-4957-a06c-fbca2d4538f9 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 200 len: 1312 microversion: 2.1 time: 0.107625 Aug 23 23:08:47.792501 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1423/2878] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:47 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:48.817879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:08:48.818599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] [instance: 7ba92e33-0332-41e6-8ae0-edb3db94d4e6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:08:48.824970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:48.825675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:48.828082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:48.828082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:08:48.828082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:08:48.828082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:08:48.844348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] HTTP exception thrown: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Request method failure captured: Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 HTTP/1.1 Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBVUyoQVblB7pqZQfITadlzM1ri-o-yBZZnpHOwSBS14LZJtwpameZki1LHLRWS_RiuqONW5kqzyPOZXWfmAt082oZI7JQHcoKgokNcz47aJev2t2uXyIJKXsDRZn8m0PFUzDfA_pK2KUA6i4isLigyUO14m7FiuCNBjTB_ozFXTzxuc Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:08:48.847105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4f9539894f147e0912a72a1855d31bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4f9539894f147e0912a72a1855d31bc", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: f4f9539894f147e0912a72a1855d31bc Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1258292528 Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: ebbf49534a8f41109f51637307270016 Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1258292528-project Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. Aug 23 23:08:48.848600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '7ba92e33-0332-41e6-8ae0-edb3db94d4e6'} Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:08:48.849378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. Aug 23 23:08:48.851950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:08:48.853145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] Returning 404 to user: Instance 7ba92e33-0332-41e6-8ae0-edb3db94d4e6 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:08:48.853145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f16d9f8-b29b-4974-9f3b-f29dfc5d86a4 tempest-ServerRescueNegativeTestJSON-1258292528 tempest-ServerRescueNegativeTestJSON-1258292528-project] 10.222.0.73 "GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6" status: 404 len: 111 microversion: 2.1 time: 0.036406 Aug 23 23:08:48.853145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1456/2879] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:08:48 2022] GET /compute/v2.1/servers/7ba92e33-0332-41e6-8ae0-edb3db94d4e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:09:07.667907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:07.668499 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:07.670767 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.674750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.676665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:07.677202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:07.677667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:07.678397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:07.678859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:07.679288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:07.702619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-392c86dc-90c6-4159-8742-170628ce4adb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/ips" status: 200 len: 150 microversion: 2.1 time: 0.038894 Aug 23 23:09:07.703433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1424/2880] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 23:09:07 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:10.473995 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60209bb1-5bc5-4957-8e6f-1576ca4a4a5e"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:10.476426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:10.478784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.479576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.485695 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:10.486195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:10.486856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:10.488295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:10.489100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:10.489547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:11.436180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-59e73153-9022-4ba7-9ca3-e77fb624907f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966830 Aug 23 23:09:11.448759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1457/2881] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 23:09:10 2022] POST /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:20.113937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4f49624b-ed5e-43ff-91f9-d1935f0345e7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: .version_select at 0x7f5ed0ed6160>, body: {"keypair": {"name": "tempest-keypair-537097453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzl3uF9699hdk6Fqc1ZFhv+IMd1nFqCvNOznWKpMHEP1fMkfnBLyX+EZ4GZctPg9rjd/ndSKRs1H0xplh0xP7ono9WnpQc4p1lTGDC58p8JqxKCJiwi0jj29EMrzHSyaA=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:20.131850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-4f49624b-ed5e-43ff-91f9-d1935f0345e7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:09:20.136076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-4f49624b-ed5e-43ff-91f9-d1935f0345e7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:09:20.228249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4f49624b-ed5e-43ff-91f9-d1935f0345e7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118910 Aug 23 23:09:20.228850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1425/2882] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:09:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:22.757239 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:22.758610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:22.763254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-400978930", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974386b3-3c24-4bb8-8a00-3bab468a71cb"}], "security_groups": [{"name": "tempest-securitygroup--1962913165"}], "key_name": "tempest-keypair-537097453", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:22.881880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] validate_networks() for [('974386b3-3c24-4bb8-8a00-3bab468a71cb', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:09:23.391564 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:09:23.391994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:09:23.392469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:09:23.392913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:09:23.393348 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:09:23.402819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:23.403298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:23.403733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:23.404447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:23.404896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:23.405345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:23.422406 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:09:23.426997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:09:23.437996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:09:23.440417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:09:23.624532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bd29a1ef-81a5-41c6-8332-dbf1426141ad tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.868813 Aug 23 23:09:23.625396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1458/2883] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:09:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 23:09:23.637309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cf91d2b7-e54a-49dd-9db7-264143fd9bdf tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:23.637931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cf91d2b7-e54a-49dd-9db7-264143fd9bdf tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:23.695011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-cf91d2b7-e54a-49dd-9db7-264143fd9bdf tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:23.703007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cf91d2b7-e54a-49dd-9db7-264143fd9bdf tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1240 microversion: 2.1 time: 0.070823 Aug 23 23:09:23.703572 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1426/2884] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:23 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:24.725306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:24.725951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:24.732528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:24.733101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:24.733534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:24.734235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:24.734687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:24.735124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:24.797911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:24.806443 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a0c73d73-c9cf-4715-8a93-9bb93895aae5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.086307 Aug 23 23:09:24.807017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1459/2885] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:24 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:25.827323 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:25.827889 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:25.835615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:25.836106 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:25.836552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:25.837299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:25.837792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:25.838222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:25.900690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:25.908672 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2dde0379-1548-4bed-bce7-737ade304364 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.085346 Aug 23 23:09:25.909276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1427/2886] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:25 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:26.929684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:26.930298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:26.936962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:26.937483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:26.938008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:26.938699 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:26.939150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:26.939600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:27.002324 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:27.010833 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-79c14667-8b95-452b-876c-4fc07c66de6e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.085387 Aug 23 23:09:27.011413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1460/2887] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:26 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:28.032402 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:28.033153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:28.040403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:28.040979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:28.041450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:28.042254 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:28.042716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:28.043140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:28.116462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:28.124575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f312fb1d-bbeb-4690-ac92-3b14f11d5eeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.096228 Aug 23 23:09:28.125214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1428/2888] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:28 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:29.146468 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:29.147079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:29.153948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:29.154434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:29.154871 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:29.155581 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:29.156044 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:29.156473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:29.219174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:29.227563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6d1fb9cb-65cc-4f16-97bd-f8024c3e84c0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.085692 Aug 23 23:09:29.228137 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1461/2889] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:29 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:30.249971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:30.250581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:30.257752 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:30.258237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:30.258675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:30.259365 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:30.259828 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:30.260247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:30.321825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:30.330078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fec43b1d-34c0-466f-aea6-446cc4c02a58 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1244 microversion: 2.1 time: 0.083921 Aug 23 23:09:30.330634 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1429/2890] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:30 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:31.351708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:31.352332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:31.359032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:31.359518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:31.359951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:31.360652 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:31.361132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:31.361551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:31.432182 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:31.441960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5b2b7302-dd97-4a5e-bf79-97c61b185f55 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1236 microversion: 2.1 time: 0.093434 Aug 23 23:09:31.442835 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1462/2891] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:31 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:32.464907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:32.465503 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:32.472141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:32.472639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:32.473118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:32.474035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:32.474484 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:32.474905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:32.543172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:32.559607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4c433254-7703-4105-8de0-25683a5fac24 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1300 microversion: 2.1 time: 0.098995 Aug 23 23:09:32.560298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1430/2892] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:32 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:33.584725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:33.585195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:33.587558 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:33.588523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:33.604056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:33.604056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:33.604056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:33.604056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:33.605266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:33.605266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:33.844579 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:33.852486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a279ba35-3e44-48a7-ab5e-065578875312 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.272765 Aug 23 23:09:33.853076 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1463/2893] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:33 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:34.404956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b6ebc7-2d73-4bb1-a380-b83a3a6be834", "tag": "8f40c7d2-9076-4724-b0f9-5408392ef38d"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:34.410541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:34.416773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:34.417320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:34.417951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:34.431081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] Creating event network-changed:8f40c7d2-9076-4724-b0f9-5408392ef38d for instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 on hv-cinder-84254 Aug 23 23:09:34.437939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-1117d03c-60f5-4c4a-97a5-d3a5504e2106 req-d957123f-4f1a-42ec-b114-f05a099d1479 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036803 Aug 23 23:09:34.438685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1431/2894] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:34.876488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:34.877173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:34.883878 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:34.884390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:34.884813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:34.885551 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:34.886017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:34.886431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:35.105792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:35.114503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71c2288a-ea76-4710-b104-678ff8e1ea2f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.241876 Aug 23 23:09:35.115099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1464/2895] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:34 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:35.419577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:09:35.420040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:09:36.136813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:36.137594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:36.145074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:36.150171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:36.150171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:36.150171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:36.150171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:36.150786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:36.291054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:36.299129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-acba89ae-c911-4d5d-b352-b8dffb111149 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.167029 Aug 23 23:09:36.304065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1432/2896] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:36 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:37.320954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:37.321604 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:37.328111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:37.328562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:37.328998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:37.329724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:37.330174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:37.330599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:37.475866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:37.484049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-844f114a-a42f-4e29-bb46-ed6e85439b80 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.167646 Aug 23 23:09:37.484692 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1465/2897] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:37 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:38.506590 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:38.508295 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:38.521652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:38.522940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:38.522940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:38.523618 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:38.524012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:38.524427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:38.683449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:38.686252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-44bffc2b-744c-45d5-b32c-625acc47a51a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.184721 Aug 23 23:09:38.687047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1433/2898] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:38 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:39.708097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:39.708831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:39.715465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:39.715937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:39.716413 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:39.717139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:39.717585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:39.718050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:39.851704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:39.859536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0dc5cac8-d703-4b7d-b9c7-13d805cba71c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.155792 Aug 23 23:09:39.860103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1466/2899] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:39 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:40.882703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:40.883329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:40.891817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:40.892800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:40.893500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:40.894327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:40.895028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:40.895907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:41.040332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:41.048356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1bbb300d-4056-4148-954d-9689eac0b073 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.170146 Aug 23 23:09:41.048940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1434/2900] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:40 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:42.071100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:42.071628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:42.078849 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:42.079349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:42.079792 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:42.080512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:42.080974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:42.081439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:42.223578 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:42.232069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-06c8273a-1944-40ca-a7c1-262e4b461d4a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.165137 Aug 23 23:09:42.232673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1467/2901] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:42 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:43.254576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:43.255205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:43.261549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:43.262030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:43.262457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:43.263137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:43.263577 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:43.263991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:43.400128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:43.408658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-345bdb7c-bd92-47db-add3-09bf549e603f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.158818 Aug 23 23:09:43.409258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1435/2902] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:43 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:44.430082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:44.430694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:44.437251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:44.437784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:44.438219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:44.438901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:44.439355 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:44.439775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:44.578596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:44.587583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5fe6d79e-287e-4c90-ae81-b246c755262c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.162241 Aug 23 23:09:44.588152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1468/2903] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:44 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:45.172623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b6ebc7-2d73-4bb1-a380-b83a3a6be834", "name": "network-vif-plugged", "status": "completed", "tag": "8f40c7d2-9076-4724-b0f9-5408392ef38d"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:45.182873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:45.183344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:45.183773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:45.195607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] Creating event network-vif-plugged:8f40c7d2-9076-4724-b0f9-5408392ef38d for instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 on hv-cinder-84254 Aug 23 23:09:45.200694 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-3eb7b6cc-8b06-4ccd-8228-0fb9bea7fe30 req-c9fe8316-8b9f-4813-978c-04bf08177edd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 Aug 23 23:09:45.201380 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1436/2904] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:45.609429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:45.610062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:45.617367 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:45.617861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:45.618307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:45.619001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:45.619796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:45.620231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:45.765787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:45.774228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0ed8928f-82ef-4b61-a0a2-5bd199f0ccae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.168834 Aug 23 23:09:45.774803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1469/2905] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:45 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:46.796540 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:46.797279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:46.804080 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:46.804565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:46.804995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:46.805707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:46.806153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:46.806573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:46.945306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:46.952266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-62be1131-3536-4470-b639-359387a7df61 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.160433 Aug 23 23:09:46.952835 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1437/2906] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:46 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:47.974471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:47.975661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:47.982623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:47.983120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:47.983559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:47.984259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:47.984970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:47.985430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:48.127459 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:48.136072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2ada2a63-fb8b-4f3c-8647-975d2dcc1576 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1366 microversion: 2.1 time: 0.166049 Aug 23 23:09:48.136712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1470/2907] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:47 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:49.160197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:49.161554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:49.168353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:49.168808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:49.169278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:49.169976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:49.170438 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:49.170864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:49.317984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:09:49.326000 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a170d714-bbb5-4560-9e43-6247c3c9bf07 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1556 microversion: 2.1 time: 0.169674 Aug 23 23:09:49.326564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1438/2908] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:09:49 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:09:49.350613 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:09:49.351170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:09:49.357649 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:49.359157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:49.359157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:49.359386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:49.359633 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:49.360047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:49.460521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3a5c1244-d02e-4642-881a-ab303f25d225 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114602 Aug 23 23:09:49.461725 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1471/2909] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 23:09:49 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:09:51.008246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b6ebc7-2d73-4bb1-a380-b83a3a6be834", "tag": "8f40c7d2-9076-4724-b0f9-5408392ef38d"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:09:51.021347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:09:51.022117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:09:51.022822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:09:51.038690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] Creating event network-changed:8f40c7d2-9076-4724-b0f9-5408392ef38d for instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 on hv-cinder-84254 Aug 23 23:09:51.044544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-2b309f49-675c-46cd-8894-8f733a2c6989 req-0e64f936-5198-463b-a748-a3a313dee6eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040210 Aug 23 23:09:51.045450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1439/2910] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:10:26.544113 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:26.547660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=78 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:26.835094 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f6739506-d3f6-4e57-a3a0-d357b3ab6472 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Action: 'create', calling method: .version_select at 0x7f5ed0ea0ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1067012192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwHnBlzp6Nvqjs/JoJvsj1u04QJr/VvBk1gANymzNiTYkWSKmK+Mg4vzHcj9heuq+4pyPwUqZKKQjfh1+PY8+UFyrWgSGLiw0Kt4/Ip/ZFPMzZtScb8hWBgwZ8rWBKjNQ=="}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:10:26.879412 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-f6739506-d3f6-4e57-a3a0-d357b3ab6472 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:10:26.887497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-f6739506-d3f6-4e57-a3a0-d357b3ab6472 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for user 51af1e82755e449993e110db493b689b and project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'key_pairs'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:10:27.089577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f6739506-d3f6-4e57-a3a0-d357b3ab6472 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.552340 Aug 23 23:10:27.090514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1472/2911] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:10:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:10:28.645851 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:28.647034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=70 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:28.798652 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce4cd208-876c-4c48-97ff-b51db3c184d8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Action: 'create', calling method: .version_select at 0x7f5ed181aa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1465176111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOMi+1B8iQpBKVhberaV+4lUz14tGXdw5M/Or9dnn2HJG5Xbf4VQrrwS2ZSiTTbJkStioMvO56kqSHyJtueIGplbtvfFdtcOT92DBFn/e2HuCufj6RFPTeJ+hBltFwHEg=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:10:28.814554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-ce4cd208-876c-4c48-97ff-b51db3c184d8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Getting quotas for project aa51baae7e1f4d318a3c9607d5cb715d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:10:28.818562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-ce4cd208-876c-4c48-97ff-b51db3c184d8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Getting quotas for user daf49a1b3de0478a939694287535607f and project aa51baae7e1f4d318a3c9607d5cb715d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:10:28.951837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce4cd208-876c-4c48-97ff-b51db3c184d8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308236 Aug 23 23:10:28.954297 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1440/2912] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:10:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:06.918876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1707002611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067012192", "security_groups": [{"name": "tempest-secgroup-smoke-563255255"}], "block_device_mapping_v2": [{"uuid": "6a006efa-c6b8-4977-bad6-8d16e4a041c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ca01363-48bc-4444-8324-bc3a2c7ab775"}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:06.928522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=4 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.035197 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] validate_networks() for [('4ca01363-48bc-4444-8324-bc3a2c7ab775', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:11:07.421255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:11:07.421824 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:11:07.422312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:11:07.422750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:11:07.423157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:11:07.432136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:07.432651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:07.433128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:07.433837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:07.434360 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:07.434697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:07.451229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:11:07.454969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for user 51af1e82755e449993e110db493b689b and project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:11:07.513637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:11:07.515687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a006efa-c6b8-4977-bad6-8d16e4a041c8',volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:11:07.925913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4dc64d7b-59ff-44a6-ac0e-37a8ea4c8945 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.011964 Aug 23 23:11:07.926641 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1473/2913] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:11:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:11:07.938064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d92fedf5-ff76-4233-a025-03b0b65f4b0c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:07.938788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d92fedf5-ff76-4233-a025-03b0b65f4b0c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:07.941950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.267654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d92fedf5-ff76-4233-a025-03b0b65f4b0c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:08.274692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d92fedf5-ff76-4233-a025-03b0b65f4b0c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1095 microversion: 2.1 time: 0.340427 Aug 23 23:11:08.275285 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1441/2914] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:07 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1095 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:09.295948 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:09.296559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:09.303037 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:09.303504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:09.303974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:09.304810 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:09.305365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:09.308070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:09.371815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:09.380032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f549b403-40b0-41d2-80f3-c0db5cf94503 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1145 microversion: 2.1 time: 0.088560 Aug 23 23:11:09.380883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1474/2915] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:09 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:10.400712 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:10.401693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:10.409604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:10.412600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:10.412600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:10.412600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:10.412600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:10.413373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:10.475398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1361376184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1465176111", "security_groups": [{"name": "tempest-secgroup-smoke-1184958774"}], "networks": [{"uuid": "b3ec5c33-6551-44bb-92b4-a51a18da8825"}], "block_device_mapping_v2": [{"uuid": "23f2c349-d4cf-4c9e-ac6e-06c75483dcbf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:10.500462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:10.510675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-362be126-111b-44cd-80e9-6b77b7927669 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1201 microversion: 2.1 time: 0.114424 Aug 23 23:11:10.513056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1442/2916] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:10 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:10.659362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] validate_networks() for [('b3ec5c33-6551-44bb-92b4-a51a18da8825', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:11:11.234957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:11:11.235463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:11:11.236067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:11:11.236474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:11:11.236881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:11:11.250745 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:11.251217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:11.251686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:11.252400 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:11.252884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:11.253391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:11.270528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Getting quotas for project aa51baae7e1f4d318a3c9607d5cb715d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:11:11.274421 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Getting quotas for user daf49a1b3de0478a939694287535607f and project aa51baae7e1f4d318a3c9607d5cb715d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:11:11.333048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:11:11.335129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23f2c349-d4cf-4c9e-ac6e-06c75483dcbf',volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:11:11.533487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:11.535011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:11.542154 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:11.542647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:11.543434 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:11.543847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:11.544310 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:11.544731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:11.707957 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:11.716617 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-38ce8614-6fee-4fdd-9d90-6ea3b0c4d51e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1278 microversion: 2.1 time: 0.189238 Aug 23 23:11:11.717226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1443/2917] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:11 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:11.926414 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aaf74497-d500-4099-baa1-78c8aaef627f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.455135 Aug 23 23:11:11.927077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1475/2918] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:11:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 23:11:11.938482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ee8bf31-a6bb-4e6d-adf5-393e9ac19f39 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:11.939109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ee8bf31-a6bb-4e6d-adf5-393e9ac19f39 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:12.008151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ee8bf31-a6bb-4e6d-adf5-393e9ac19f39 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:12.016137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ee8bf31-a6bb-4e6d-adf5-393e9ac19f39 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1089 microversion: 2.1 time: 0.081502 Aug 23 23:11:12.028650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1444/2919] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:11 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:12.741683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:12.742288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:12.748417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:12.748899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:12.749365 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:12.750042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:12.750488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:12.750954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:12.956858 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:12.965594 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fdf4615d-02ed-4f28-8b9b-6c7c39e4e559 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.228380 Aug 23 23:11:12.966202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1476/2920] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:12 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:13.006996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb0b9d-ac31-476e-8994-feb610f6b831", "tag": "846b424c-98e3-4079-b697-8a3836407f16"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:13.019843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:13.020527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:13.021183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:13.033305 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] Creating event network-changed:846b424c-98e3-4079-b697-8a3836407f16 for instance 1afb0b9d-ac31-476e-8994-feb610f6b831 on hv-cinder-84254 Aug 23 23:11:13.038489 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-d7f90229-03a2-498f-b965-7186248b724e req-a210d316-8f55-45cf-b209-16bfdd2e3e80 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Aug 23 23:11:13.039511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1445/2921] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:13.040625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42fd3338-ebb4-47ad-bc48-f424b51f1057 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:13.041974 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42fd3338-ebb4-47ad-bc48-f424b51f1057 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:13.097843 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-42fd3338-ebb4-47ad-bc48-f424b51f1057 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:13.105078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42fd3338-ebb4-47ad-bc48-f424b51f1057 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1089 microversion: 2.1 time: 0.070457 Aug 23 23:11:13.105724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1477/2922] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:13 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:13.986622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:13.987345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:13.993506 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:13.993992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:13.994422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:13.995097 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:13.995545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:13.995958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:14.126055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:14.126767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:14.129997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:14.135946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:14.136431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:14.136862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:14.137576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:14.137874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2e5be64b-ac02-45a8-a1ce-da6d11790cd7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.155457 Aug 23 23:11:14.138019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:14.138441 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:14.138536 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1446/2923] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:13 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:14.200842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:14.208712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b39b50ea-f0b1-41d8-9b1f-468a3844c1ee tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1131 microversion: 2.1 time: 0.086550 Aug 23 23:11:14.209327 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1478/2924] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:14 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1131 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:15.158993 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:15.159606 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:15.166227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:15.166718 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:15.167151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:15.167843 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:15.168296 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:15.168728 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:15.232908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:15.234169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:15.241056 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:15.241788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:15.242225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:15.243102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:15.243807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:15.244758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:15.315162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:15.317435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:15.323793 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e0a3c339-9f3b-4687-929f-5095ee459d31 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1187 microversion: 2.1 time: 0.094979 Aug 23 23:11:15.324377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1479/2925] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:15 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:15.332433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d7e49027-b6e9-4e5a-97b0-abecf4e8d0c1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.172534 Aug 23 23:11:15.332433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1447/2926] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:15 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:16.344864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:16.345605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:16.347288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:16.348479 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:16.352391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:16.353060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:16.354025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:16.354810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:16.355275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:16.355390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:16.355704 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:16.355819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:16.356278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:16.356986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:16.357523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:16.357986 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:16.421759 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:16.430044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e3931feb-4b97-431c-a2f8-c89861e469f7 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1205 microversion: 2.1 time: 0.089358 Aug 23 23:11:16.430743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1448/2927] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:16 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:16.578971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:16.586637 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f382b076-8056-4c7b-8ea0-6b258ca635cb tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.243459 Aug 23 23:11:16.587256 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1480/2928] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:16 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:17.450382 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:17.451264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:17.457749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:17.458241 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:17.458677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:17.459379 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:17.459838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:17.460269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:17.602512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:17.607960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:17.611127 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:17.614004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0a99fddc-06ce-4f58-8868-93441fad0570 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1273 microversion: 2.1 time: 0.167558 Aug 23 23:11:17.614570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1449/2929] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:17 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:17.614945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:17.615434 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:17.615872 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:17.616568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:17.617032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:17.617511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:17.738064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:17.748335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:17.748821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:17.749354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:17.761467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] Creating event network-changed:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:11:17.766812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-0c38c11a-4f69-4bcf-ae57-239c00465ce7 req-871bf16b-09bf-4c3c-a4b4-1ed8585453fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032759 Aug 23 23:11:17.767783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1450/2930] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:17.800790 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:17.809681 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e1160a69-f3f6-4ac5-9576-d9f1dada12aa tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.205782 Aug 23 23:11:17.810267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1481/2931] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:17 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:18.637262 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:18.637875 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:18.644059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:18.649247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:18.649247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:18.649247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:18.649247 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:18.649578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:18.784195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:18.792172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-508b7979-6e71-43ad-a984-7b7e9ad9fdb2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.160594 Aug 23 23:11:18.792751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1451/2932] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:18 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:18.830622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:18.844799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:18.844799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:18.844799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:18.844799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:18.845229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:18.845229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:18.845229 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:18.993710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:18.993710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-71cd82ee-bfa3-4ece-925d-4b20c85eed83 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.156407 Aug 23 23:11:18.993710 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1482/2933] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:18 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:19.813346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:19.813933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:19.820266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:19.820739 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:19.821204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:19.821935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:19.823062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:19.823525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:19.961909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:19.970521 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5dec5651-0942-4c5c-9ce9-96c96d1d911d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.161222 Aug 23 23:11:19.971086 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1452/2934] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:19 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:20.003656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:20.004308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:20.011147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:20.011654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:20.012095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:20.012778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:20.013284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:20.013709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:20.148975 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:20.157788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bc906f16-3cb5-490b-8e05-e076027c5085 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.158022 Aug 23 23:11:20.158351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1483/2935] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:19 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:20.990559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:20.991158 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:20.997766 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:20.998243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:20.998675 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:20.999344 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:20.999787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:21.000199 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:21.136141 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:21.144092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d7cc5ee5-01dd-4b30-8c69-11d2330c5be4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.157367 Aug 23 23:11:21.144658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1453/2936] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:20 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:21.178525 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:21.179132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:21.186278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:21.186839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:21.187331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:21.188376 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:21.188883 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:21.189431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:21.261621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=4 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.327983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:21.336054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8052f28a-189e-4b54-8d3d-90987447e05a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.161588 Aug 23 23:11:21.336698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1484/2937] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:21 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:22.165798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:22.166410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:22.169487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.174389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:22.174872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:22.181475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:22.181475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:22.181475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:22.181475 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:22.311582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:22.319119 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7ff2db62-8521-4c35-9175-4e2c0cba96c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.157231 Aug 23 23:11:22.319721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1454/2938] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:22 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:22.357856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:22.358502 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:22.364845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:22.365361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:22.365826 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:22.366494 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:22.366957 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:22.367378 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:22.502758 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:22.510427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-27e2d0fd-c4ab-43bf-811c-6333a7d811a1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.157196 Aug 23 23:11:22.510966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1485/2939] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:22 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:23.339962 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:23.340809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:23.347238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:23.347743 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:23.348173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:23.348908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:23.349453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:23.349873 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:23.487820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:23.494019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-05a6ecfe-2c90-48e7-8616-6d85f1d9a300 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.158505 Aug 23 23:11:23.497927 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1455/2940] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:23 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:23.531193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:23.531832 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:23.534009 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=14 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:23.539685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:23.540178 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:23.540622 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:23.541347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:23.541802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:23.542226 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:23.676576 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:23.684274 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-32cfb56b-68e0-4b24-ad4f-15ed963db734 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.157840 Aug 23 23:11:23.684839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1486/2941] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:23 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:24.516092 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:24.516613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:24.522980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:24.523490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:24.523922 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:24.524604 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:24.525081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:24.525505 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:24.661924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:24.670546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-66a16f30-9c27-4367-9e62-7207d8fc0a02 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.158890 Aug 23 23:11:24.671105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1456/2942] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:24 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:24.704029 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:24.704638 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:24.711218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:24.711705 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:24.712139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:24.712820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:24.713298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:24.713748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:24.855992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:24.863632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e5c81f59-5078-4eed-8271-61628aa8e051 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.163822 Aug 23 23:11:24.864220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1487/2943] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:24 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:25.692753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:25.693410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:25.700909 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:25.701422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:25.701862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:25.702586 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:25.703029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:25.703456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:25.719049 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb0b9d-ac31-476e-8994-feb610f6b831", "name": "network-vif-plugged", "status": "completed", "tag": "846b424c-98e3-4079-b697-8a3836407f16"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:25.728937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:25.729419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:25.730098 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:25.741884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] Creating event network-vif-plugged:846b424c-98e3-4079-b697-8a3836407f16 for instance 1afb0b9d-ac31-476e-8994-feb610f6b831 on hv-cinder-84254 Aug 23 23:11:25.745531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR oslo.messaging._drivers.impl_rabbit [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] [c5194d89-6d48-4234-963f-7d439ef5c1f0] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 23:11:25.837048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:25.845355 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f6607780-e930-4131-ba46-445d1572a04f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.156540 Aug 23 23:11:25.845924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1457/2944] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:25 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:25.884399 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:25.885020 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:25.891261 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:25.891751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:25.894061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:25.894061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:25.894061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:25.894061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:26.028530 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:26.036551 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-aa81ad19-1fef-4765-8dfb-908199b00631 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.156034 Aug 23 23:11:26.037146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1458/2945] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:25 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:26.753307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] [c5194d89-6d48-4234-963f-7d439ef5c1f0] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58592. Aug 23 23:11:26.756599 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-80edfe53-6a59-4c87-8341-23e08346c9d0 req-fcc9c60e-a05c-40e9-81f7-36c3ff24c334 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041704 Aug 23 23:11:26.757235 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1488/2946] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:11:26.867026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:26.867640 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:26.874313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:26.874805 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:26.875246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:26.875942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:26.876401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:26.876859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:27.011214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:27.019965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-605f63d2-028c-43f3-987c-1ac7217d1431 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.156969 Aug 23 23:11:27.020538 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1459/2947] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:26 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:27.059151 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:27.060031 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:27.066598 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:27.067078 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:27.067521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:27.068203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:27.068655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:27.069105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:27.238181 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:27.246519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fbd8f111-8387-4497-9747-3fc06460b978 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.191749 Aug 23 23:11:27.247266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1489/2948] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:27 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:28.041071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:28.041615 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:28.048908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:28.049416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:28.049846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:28.050525 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:28.051012 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:28.051384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:28.184351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:28.188919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:28.193453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-457fbee0-5d12-416b-a892-fa4bd1564cf5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.156319 Aug 23 23:11:28.194074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1460/2949] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:28 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:28.267906 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:28.268519 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:28.275129 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:28.276416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:28.276867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:28.277688 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:28.278159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:28.278591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:28.410750 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:28.418713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8ee121e7-c9d5-4328-969c-d5ec3ad26883 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1266 microversion: 2.1 time: 0.154575 Aug 23 23:11:28.419298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1490/2950] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:28 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:29.215692 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:29.216304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:29.223731 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.224628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.225100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.225800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.226249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.226668 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.363121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:29.371188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fdd9165f-18b8-4ea9-aba6-57d4136f2f75 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.159817 Aug 23 23:11:29.371751 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1461/2951] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:29 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:29.442243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:29.442885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:29.449661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.450155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.450597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.451314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.451769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.452219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.593482 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:29.601328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e8af440f-a940-4ad7-8105-a19e99e4ca76 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1453 microversion: 2.1 time: 0.164587 Aug 23 23:11:29.601890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1491/2952] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:29 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:29.621941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:29.622559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:29.628609 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.629171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.629674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.630347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.630809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.631236 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.765118 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:29.774716 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-83f1c5cd-f248-46cf-9925-de77a52f149b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1453 microversion: 2.1 time: 0.156711 Aug 23 23:11:29.775278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1462/2953] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:29 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:29.928298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "name": "network-vif-plugged", "status": "completed", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:29.939830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:29.940380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:29.940880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:29.952724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] Creating event network-vif-plugged:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:11:29.958555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-e643e92c-652f-4f08-9798-bb7285695183 req-9ad31262-1492-4148-a9f0-88b99fd83420 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034519 Aug 23 23:11:29.960653 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1492/2954] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:30.392209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:30.393377 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:30.400921 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:30.404686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:30.404686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:30.404686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:30.404686 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:30.405392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:30.551183 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:30.559733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ff7b697b-79fc-43ce-8935-c7b00f43135d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.171376 Aug 23 23:11:30.560517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1463/2955] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:30 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:31.337405 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:31.338060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:31.345270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.350349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.350349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.350349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.350349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.350734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.351522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.373071 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fe0b52c4-c5ed-43b3-9ac4-3b5e26908958 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/ips" status: 200 len: 150 microversion: 2.1 time: 0.040017 Aug 23 23:11:31.378767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1493/2956] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 23:11:31 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:31.390021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60209bb1-5bc5-4957-8e6f-1576ca4a4a5e"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:31.393972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:31.405197 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.406333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.407132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.408383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.409267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.410090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.507951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: POST /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/os-volume_attachments HTTP/1.1 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 74 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:11:31.509690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {"volumeAttachment": {"volumeId": "60209bb1-5bc5-4957-8e6f-1576ca4a4a5e"}} Aug 23 23:11:31.511120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'server_id': 'b6b6ebc7-2d73-4bb1-a380-b83a3a6be834', 'body': {'volumeAttachment': {'volumeId': '60209bb1-5bc5-4957-8e6f-1576ca4a4a5e'}}} Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:31.512439 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:31.518129 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 400 to user: Invalid volume: volume 60209bb1-5bc5-4957-8e6f-1576ca4a4a5e is already attached to instances: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-97f34673-9773-44ec-816f-137bbd97e4e2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129064 Aug 23 23:11:31.519446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1464/2957] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 23:11:31 2022] POST /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 23:11:31.520302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:31.520799 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:31.528021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.528654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.529187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.529875 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.530330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.530756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.557133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:11:31.580872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:31.580872 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:31.587746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.588332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.588846 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.590309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:31.590910 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:31.591413 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:31.728746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:31.737383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-14ceb489-2dea-45d4-8134-a5dfc61923d0 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1261 microversion: 2.1 time: 0.161354 Aug 23 23:11:31.738060 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1465/2958] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:31 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:31.986645 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-91db03b7-e470-4b21-aacd-a0a4c5a89b00 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 204 len: 0 microversion: 2.1 time: 0.470124 Aug 23 23:11:31.987671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1494/2959] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:11:31 2022] DELETE /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:31.996087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:31.998854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:32.003172 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.003666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.004138 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.004944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.005428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.005847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.145265 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:32.153445 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d56377fa-8c70-4d05-a611-21d41019704b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1681 microversion: 2.1 time: 0.161412 Aug 23 23:11:32.154007 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1466/2960] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:31 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:32.232517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb0b9d-ac31-476e-8994-feb610f6b831", "tag": "846b424c-98e3-4079-b697-8a3836407f16"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:32.242006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.242629 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.243104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.255808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] Creating event network-changed:846b424c-98e3-4079-b697-8a3836407f16 for instance 1afb0b9d-ac31-476e-8994-feb610f6b831 on hv-cinder-84254 Aug 23 23:11:32.260888 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-13fdff74-c9ab-4abb-85cf-7fd85c5501cb req-f1245dcb-95ac-46d7-95de-9f575f378fab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032662 Aug 23 23:11:32.262170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1495/2961] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:32.758478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:32.758997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:32.765642 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.766136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.766575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.767276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.767733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.768190 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.910272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:32.919035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b353dd73-bd3b-45a5-b127-2ad36c12204e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1445 microversion: 2.1 time: 0.164568 Aug 23 23:11:32.919610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1467/2962] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:32 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:32.940476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:32.941231 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:32.945030 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.948648 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.949349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.949797 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:32.950499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:32.950962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:32.951388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:33.095436 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:33.103390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8451caee-b5ef-41dc-9eb1-eb29c8718bc1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1445 microversion: 2.1 time: 0.167114 Aug 23 23:11:33.109217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1496/2963] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:32 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:33.175537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:33.177832 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:33.182146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:33.182632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:33.183064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:33.184583 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:33.185071 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:33.185478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:33.330732 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:33.338416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-45793fb3-8f9c-445f-b29c-95afd256b4a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1681 microversion: 2.1 time: 0.166946 Aug 23 23:11:33.338968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1468/2964] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:33 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:34.359320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:34.359920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:34.366222 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:34.366697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:34.367128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:34.367802 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:34.368247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:34.368672 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:34.506952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:34.514782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97c4a5db-a537-46d0-933e-e3af204aef04 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1681 microversion: 2.1 time: 0.160328 Aug 23 23:11:34.515344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1497/2965] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:34 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:35.306252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:35.317457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:35.318018 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:35.318504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:35.332373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] Creating event network-changed:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:11:35.337558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-1ddd4210-9404-45a3-a564-58157e100684 req-2fe61fab-2850-4654-9220-af98184ad1c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Aug 23 23:11:35.338607 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1469/2966] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:35.537660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:35.538271 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:35.546884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:35.547615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:35.548206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:35.549099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:35.549724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:35.550439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:35.597026 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b6ebc7-2d73-4bb1-a380-b83a3a6be834", "name": "network-vif-deleted", "tag": "8f40c7d2-9076-4724-b0f9-5408392ef38d"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:35.608842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:35.609781 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:35.610442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:35.625345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] Creating event network-vif-deleted:8f40c7d2-9076-4724-b0f9-5408392ef38d for instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 on hv-cinder-84254 Aug 23 23:11:35.638904 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-dbd60b2c-f004-41f2-95d8-72681126c93a req-18300292-83ae-4bf6-83da-a56e8c99d1a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045791 Aug 23 23:11:35.640202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1470/2967] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:35.671465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:35.682107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f64d4e7-77bb-4c85-a1ff-140873204f21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1613 microversion: 2.1 time: 0.149576 Aug 23 23:11:35.682702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1498/2968] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:35 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:36.705208 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:36.705850 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:36.712328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:36.712894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:36.714292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:36.715845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:36.716349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:36.716783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:36.752812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:36.753335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:36.755418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:36.755418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'fault' on Instance uuid b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:11:36.813028 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:36.822449 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-a071ef1f-e5e7-40b6-9190-b380c0d4c684 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 200 len: 1330 microversion: 2.1 time: 0.122058 Aug 23 23:11:36.823281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1471/2969] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:36 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:37.845701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:37.846352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:37.853136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:37.853624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:37.854091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:37.854934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:37.855703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:37.856173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:37.872062 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 HTTP/1.1 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:11:37.873912 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:11:37.875275 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'b6b6ebc7-2d73-4bb1-a380-b83a3a6be834'} Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:11:37.876088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:11:37.877352 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:11:37.878536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:11:37.878536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-69f5cf6e-de60-4798-96f7-c3ff010e8e69 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 404 len: 111 microversion: 2.1 time: 0.033573 Aug 23 23:11:37.878536 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1499/2970] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:37 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:11:37.884040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d76fec20-bd12-4c1c-94da-0f18c2f0034c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '.version_select at 0x7f5ed57a3310>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:38.027800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d76fec20-bd12-4c1c-94da-0f18c2f0034c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-537097453" status: 202 len: 0 microversion: 2.1 time: 0.147401 Aug 23 23:11:38.028408 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1472/2971] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 23:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-537097453 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:11:38.864899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:38.865395 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:38.871778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:38.872264 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:38.873439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:38.874048 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:38.874493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:38.874915 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:38.955897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'services' on Instance uuid 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:11:39.186218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e1a006c4-cbad-4767-873d-24a3b35725e6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments/60209bb1-5bc5-4957-8e6f-1576ca4a4a5e" status: 202 len: 0 microversion: 2.1 time: 0.324947 Aug 23 23:11:39.186820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1500/2972] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 23:11:38 2022] DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments/60209bb1-5bc5-4957-8e6f-1576ca4a4a5e => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:11:39.195941 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:39.198817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:39.200893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.206793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:39.207225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:39.207661 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:39.208354 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:39.208836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:39.209263 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:39.239913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-cc8c31f2-0382-4a65-9dcf-25eccff5b88b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048479 Aug 23 23:11:39.240471 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1473/2973] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:11:39 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:40.255043 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:40.257398 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:40.263676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:40.264350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:40.264786 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:40.265504 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:40.265959 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:40.266383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:40.297203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9f9fbfb8-1603-4d11-87c2-a442c902a758 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046930 Aug 23 23:11:40.297762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1501/2974] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:11:40 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:41.310518 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:41.312864 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:41.319905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.320386 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.320822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:41.321544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.321990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.322411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:41.353502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-899a587f-267c-4280-8d34-f5dcdc2ebce2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047419 Aug 23 23:11:41.354055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1474/2975] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:11:41 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 23:11:41.416177 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:41.416697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:41.423337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.423820 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.424283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:41.424966 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.425447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.425865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:41.454128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:11:41.861646 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7b5698b6-4e76-4a65-8fa7-b6f69e511ebb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 204 len: 0 microversion: 2.1 time: 0.448881 Aug 23 23:11:41.862243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1502/2976] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:11:41 2022] DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:41.870791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:41.871397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:41.878537 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.879016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.879444 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:41.880128 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:41.880575 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:41.881229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:42.032951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:42.041610 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c61c12b6-e4c2-49f9-b39f-ae0d66633097 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1683 microversion: 2.1 time: 0.175045 Aug 23 23:11:42.042188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1475/2977] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:41 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:43.064905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:43.065524 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:43.071854 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:43.072328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:43.072759 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:43.073460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:43.073905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:43.074319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:43.207580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:43.215566 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9fd8ef3d-84eb-4af9-afdd-798da4f5966f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1683 microversion: 2.1 time: 0.154989 Aug 23 23:11:43.216140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1503/2978] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:43 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:44.237580 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:44.238192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:44.244696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:44.245243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:44.245680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:44.246370 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:44.246842 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:44.247246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:44.378068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:44.385918 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5e0e2bdd-a70d-4784-a4ad-fbda797007af tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1683 microversion: 2.1 time: 0.152210 Aug 23 23:11:44.386487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1476/2979] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:44 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:45.408411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:45.409054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:45.416286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:45.416825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:45.417294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:45.418337 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:45.419022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:45.419216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:45.490238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa78a5b-a84b-4b0f-895f-73bba0ed5810", "name": "network-vif-deleted", "tag": "b4dfe160-d37a-47b1-976f-4675a4218e58"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:45.502161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:45.502295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:45.502519 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:45.503189 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:45.509859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1b1332ad-019e-4e4c-80e4-9554f1b8dcb1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1615 microversion: 2.1 time: 0.105762 Aug 23 23:11:45.510606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1504/2980] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:45 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:45.520058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] Creating event network-vif-deleted:b4dfe160-d37a-47b1-976f-4675a4218e58 for instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 on hv-cinder-84254 Aug 23 23:11:45.526299 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-c71e0593-3104-406b-bb28-0d2b886b2fed req-e3db9b1c-8203-4f66-aa23-643dca49a724 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047385 Aug 23 23:11:45.526997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1477/2981] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:11:46.533481 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:46.539358 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:46.541473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:46.541964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:46.542401 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:46.543099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:46.543549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:46.543969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:46.580081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:46.580559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:46.580993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:46.581499 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'fault' on Instance uuid 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:11:46.622189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:46.631153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-14f52016-447f-48bf-ad7b-f41f1f37784b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 200 len: 1332 microversion: 2.1 time: 0.102779 Aug 23 23:11:46.631734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1505/2982] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:46 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:47.654548 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:47.655249 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:47.661814 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:47.662290 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:47.663528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:47.663528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:47.663924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:47.664345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:47.678132 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 HTTP/1.1 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:11:47.679736 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:11:47.681107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '7fa78a5b-a84b-4b0f-895f-73bba0ed5810'} Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:11:47.681793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:11:47.683022 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:11:47.684209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:11:47.684209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8a93980a-82eb-4b81-9dc5-098706965704 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 404 len: 111 microversion: 2.1 time: 0.031611 Aug 23 23:11:47.684209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1478/2983] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:47 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:11:47.691204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8a59ee68-eece-4fa3-8659-2cdd578c4f31 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '.version_select at 0x7f5ed0fbea60>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:47.840859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8a59ee68-eece-4fa3-8659-2cdd578c4f31 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981624585" status: 202 len: 0 microversion: 2.1 time: 0.153997 Aug 23 23:11:47.841870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1506/2984] 10.222.0.73 () {58 vars in 1221 bytes} [Tue Aug 23 23:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981624585 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 23:11:48.663034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7d8964f2-3464-4811-a5b3-5f7dbcc47427 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: .version_select at 0x7f5ed17ae040>, body: {"keypair": {"name": "tempest-keypair-275440094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjyqYaMDS22DdMyo6txowyqF0Mj9MGLBM9rNvid8Ct2d/MsaWizARv2RSe1i5QXURBhGlHT79/nFyR5gKeNC8zibfwro0RH8aQB4zAgrzygxCgIEIMY+MFdtnXigQKi5g=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:48.679504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-7d8964f2-3464-4811-a5b3-5f7dbcc47427 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:11:48.683421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-7d8964f2-3464-4811-a5b3-5f7dbcc47427 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:11:48.832539 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7d8964f2-3464-4811-a5b3-5f7dbcc47427 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173531 Aug 23 23:11:48.833213 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1479/2985] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:11:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:11:51.362260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1394500170", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974386b3-3c24-4bb8-8a00-3bab468a71cb"}], "security_groups": [{"name": "tempest-securitygroup--1322927694"}], "key_name": "tempest-keypair-275440094", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:51.466019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] validate_networks() for [('974386b3-3c24-4bb8-8a00-3bab468a71cb', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:11:51.831463 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:11:51.831884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:11:51.832363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:11:51.832770 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:11:51.833225 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:11:51.841992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:51.842501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:51.842902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:51.844150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:51.844989 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:51.845444 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:51.863469 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:11:51.867411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:11:51.879114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:11:51.881449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:11:52.035889 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd8f3ea9-f4cd-4eef-8cbf-bcd07dc4b9d6 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679386 Aug 23 23:11:52.036675 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1507/2986] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:11:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:11:52.049217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f050f497-f84a-4633-911e-df1f6ecdb560 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:52.049943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f050f497-f84a-4633-911e-df1f6ecdb560 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:52.106267 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f050f497-f84a-4633-911e-df1f6ecdb560 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:52.113938 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f050f497-f84a-4633-911e-df1f6ecdb560 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1241 microversion: 2.1 time: 0.070125 Aug 23 23:11:52.114627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1480/2987] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:52 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:53.135850 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:53.136483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:53.144800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:53.145383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:53.145819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:53.146508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:53.146960 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:53.147386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:53.209686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:53.213330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.217852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0b79659-d478-4b65-953f-54db260febba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1245 microversion: 2.1 time: 0.086058 Aug 23 23:11:53.218449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1508/2988] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:53 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:54.238848 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:54.239451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:54.245410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:54.245886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:54.246320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:54.246989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:54.247436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:54.247847 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:54.309780 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:54.317689 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5e18144f-2780-49f3-8405-d10bb0e98dc8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1293 microversion: 2.1 time: 0.082899 Aug 23 23:11:54.318253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1481/2989] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:54 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:55.339520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:55.340132 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:55.349429 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:55.349958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:55.350396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:55.351097 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:55.351620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:55.352047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:55.495730 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:55.503708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-43800484-c274-4f24-8258-94441c1dc350 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.168502 Aug 23 23:11:55.504286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1509/2990] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:55 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:56.524919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:56.525569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:56.532345 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:56.532830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:56.533328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:56.534065 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:56.534524 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:56.534968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:56.678717 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:56.682125 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=100 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.686635 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55615655-fa0b-4473-ac4d-a72b4ee681e2", "tag": "add96d97-fe96-459b-802e-632e4109bb25"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:11:56.687136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-37bdefc0-af73-4684-a3ef-b971bd783124 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.165754 Aug 23 23:11:56.687452 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1482/2991] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:56 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:56.713099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:56.713580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:56.714013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:56.725522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] Creating event network-changed:add96d97-fe96-459b-802e-632e4109bb25 for instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 on hv-cinder-84254 Aug 23 23:11:56.730314 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-c17fe0b1-b870-4028-9284-5de756656315 req-8ab56c55-0bd1-404c-895d-02d22007c3c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051937 Aug 23 23:11:56.730953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1510/2992] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:11:57.708222 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:57.714176 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:57.715915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:57.716400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:57.716839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:57.717565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:57.718017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:57.718440 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:57.854173 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:57.862034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1082daf9-2b6b-4413-b6ff-5b6e7b87c044 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.158183 Aug 23 23:11:57.863276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1483/2993] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:57 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:58.885234 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:11:58.885864 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:11:58.892198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:58.892709 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:58.893171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:58.893866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:11:58.894320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:11:58.894727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:11:59.042713 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:11:59.051084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-babf9dc1-a4a7-4ff7-9fd5-5c942fa2e31a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.170587 Aug 23 23:11:59.051673 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1511/2994] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:11:58 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:00.071944 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:00.072593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:00.079327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:00.079811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:00.080278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:00.080961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:00.081701 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:00.082253 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:00.210738 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:00.218398 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b92fba3b-d0e8-404e-a8d1-5c3f8e9fc7ac tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.150412 Aug 23 23:12:00.218968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1484/2995] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:00 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:01.239778 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:01.240492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:01.247371 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:01.247842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:01.248300 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:01.248970 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:01.249447 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:01.249859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:01.378119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:01.386047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-39445920-464f-4948-9536-2f1653f37294 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.150253 Aug 23 23:12:01.386607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1512/2996] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:01 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:02.407347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:02.407972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:02.410682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.415620 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:02.416117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:02.416559 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:02.417298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:02.417757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:02.418185 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:02.552271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:02.560801 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0e66b353-7a1f-4d9b-9e0c-bc4df20ae8dd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.157871 Aug 23 23:12:02.561401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1485/2997] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:02 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:03.581863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:03.582497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:03.585120 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.585782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=6 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.591047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:03.591531 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:03.591956 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:03.592680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:03.593096 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:03.593518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:03.729715 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:03.740196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d3609ac0-cacb-428f-999f-5991bdcc2399 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.159564 Aug 23 23:12:03.740196 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1513/2998] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:03 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:03.883077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55615655-fa0b-4473-ac4d-a72b4ee681e2", "name": "network-vif-plugged", "status": "completed", "tag": "add96d97-fe96-459b-802e-632e4109bb25"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:12:03.893373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:03.894710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:03.894710 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:03.905550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] Creating event network-vif-plugged:add96d97-fe96-459b-802e-632e4109bb25 for instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 on hv-cinder-84254 Aug 23 23:12:03.911048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-bd1c0435-2d30-42b9-80b9-67df471ed796 req-7f314fe8-503a-47c8-aa4d-6d185facb725 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Aug 23 23:12:03.911674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1486/2999] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:12:04.758903 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:04.759503 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:04.761764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.766485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:04.766950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:04.767390 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:04.768243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:04.768689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:04.769135 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:04.900394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:04.908119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-8e826016-65a6-4874-8d7a-7a3b6a1c55ec tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.153281 Aug 23 23:12:04.908676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1514/3000] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:04 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:05.931240 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:05.931949 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:05.938771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:05.939332 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:05.939854 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:05.940547 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:05.941055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:05.941509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:06.080409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:06.089064 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-52acba79-ca83-4d0d-b4c9-577f2480f6a4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1367 microversion: 2.1 time: 0.163276 Aug 23 23:12:06.089631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1487/3001] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:05 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:07.110996 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:07.111545 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:07.119064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:07.119555 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:07.119990 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:07.120677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:07.121153 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:07.121577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:07.264934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:12:07.272663 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f5b3ab56-09ee-47c5-9509-08864e479d60 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1558 microversion: 2.1 time: 0.165601 Aug 23 23:12:07.273268 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1515/3002] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:12:07 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:07.293393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:12:07.293912 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:12:07.300204 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:07.300677 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:07.301137 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:07.301813 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:07.302252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:07.302666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:07.383178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-83853a44-98e6-499d-ad25-e72e4d5e6c76 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094302 Aug 23 23:12:07.383845 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1488/3003] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 23:12:07 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:12:08.393847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55615655-fa0b-4473-ac4d-a72b4ee681e2", "tag": "add96d97-fe96-459b-802e-632e4109bb25"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:12:08.405039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:12:08.405510 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:12:08.405937 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:12:08.418913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] Creating event network-changed:add96d97-fe96-459b-802e-632e4109bb25 for instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 on hv-cinder-84254 Aug 23 23:12:08.424200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-fdce32a4-8599-4a32-b6db-ce0ba930cfb6 req-02e8752e-0f75-4487-ae04-f29b1704d403 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Aug 23 23:12:08.424813 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1516/3004] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:12:55.427859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:12:55.428427 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:13:23.460463 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 23:13:23.461202 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.461750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=30 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:23.526950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:23.526950 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:23.529244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:23.529786 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:23.530228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:23.530908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:23.531356 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:23.531775 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:23.555552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-86251754-dfbc-4b0c-93de-c3f799a4091a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.097355 Aug 23 23:13:23.556100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1489/3005] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 23:13:23 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:26.347385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=5 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:26.348157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=40 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:26.353100 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cef04d10-9649-4c0b-a335-ff65acba25e9"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:26.355486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:26.361484 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:26.362439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:26.362439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:26.363047 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:26.363496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:26.363916 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:27.285954 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b29e7282-014a-44d0-ae10-96d80d23ea65 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940428 Aug 23 23:13:27.286679 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1517/3006] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 23:13:26 2022] POST /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:35.871700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cef04d10-9649-4c0b-a335-ff65acba25e9"}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:35.874124 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:35.877058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=4 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:35.885401 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:35.886099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:35.886544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:35.887232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:35.887685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:35.888109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:35.891312 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58898. Aug 23 23:13:36.022867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: POST /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments HTTP/1.1 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 74 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:13:36.025145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {"volumeAttachment": {"volumeId": "cef04d10-9649-4c0b-a335-ff65acba25e9"}} Aug 23 23:13:36.026935 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'server_id': '55615655-fa0b-4473-ac4d-a72b4ee681e2', 'body': {'volumeAttachment': {'volumeId': 'cef04d10-9649-4c0b-a335-ff65acba25e9'}}} Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:36.027776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:36.029131 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 400 to user: Invalid volume: volume cef04d10-9649-4c0b-a335-ff65acba25e9 is already attached to instances: 55615655-fa0b-4473-ac4d-a72b4ee681e2 {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-bf9b3b82-eff6-4af3-9cb2-d1848030a191 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159987 Aug 23 23:13:36.030391 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1490/3007] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 23:13:35 2022] POST /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 23:13:36.093547 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:36.094157 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:36.100304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:36.100863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:36.101331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:36.102022 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:36.102476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:36.103703 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:36.184426 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'services' on Instance uuid 55615655-fa0b-4473-ac4d-a72b4ee681e2 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:13:36.413926 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-42a9dfbd-c550-45d7-b891-572d5ecc4863 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments/cef04d10-9649-4c0b-a335-ff65acba25e9" status: 202 len: 0 microversion: 2.1 time: 0.325104 Aug 23 23:13:36.414528 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1518/3008] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 23:13:36 2022] DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments/cef04d10-9649-4c0b-a335-ff65acba25e9 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:13:36.423294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:36.425462 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:36.432001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:36.432504 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:36.432936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:36.433665 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:36.434112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:36.434635 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:36.466014 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f7d80eb4-c494-47b6-923d-4642c5955cdd tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046666 Aug 23 23:13:36.466565 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1491/3009] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:13:36 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:37.479677 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:37.482666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:37.489837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:37.490325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:37.490756 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:37.491439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:37.491880 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:37.492297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:37.522200 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae02a3f9-c8e8-431b-b8b6-c099fcc4ee99 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047828 Aug 23 23:13:37.522761 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1519/3010] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:13:37 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:38.535859 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:38.538149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:38.545156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:38.545631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:38.546207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:38.546890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:38.547336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:38.547753 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:38.576818 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-17b3a5fd-f23f-40a9-a879-922d0833124c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045408 Aug 23 23:13:38.577389 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1492/3011] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:13:38 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 23:13:38.639497 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:38.640001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:38.646361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:38.646846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:38.647284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:38.647971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:38.648425 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:38.648856 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:38.677702 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:13:39.117712 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-900f5e80-e132-4df0-9b57-20962326e08f tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 204 len: 0 microversion: 2.1 time: 0.481657 Aug 23 23:13:39.119155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1520/3012] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:13:38 2022] DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:39.127246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:39.127934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:39.135016 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:39.135748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:39.136363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:39.137075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:39.137601 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:39.138192 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:39.278621 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:39.286865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-35225a41-1843-4b7d-8c73-d6fe72d3d2da tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1682 microversion: 2.1 time: 0.163480 Aug 23 23:13:39.287430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1493/3013] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:39 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:40.308175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:40.308879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:40.315462 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:40.315945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:40.316385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:40.317101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:40.317556 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:40.318316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:40.452664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:40.460336 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c8189c82-a27e-4676-a8ab-68f9b2dda7e8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1682 microversion: 2.1 time: 0.156714 Aug 23 23:13:40.460895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1521/3014] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:40 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:41.482023 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:41.483100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:41.489723 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:41.490209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:41.490651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:41.491343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:41.491793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:41.492218 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:41.708514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:41.716784 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4ae11bfb-8673-4981-aa01-a1e0051ee4ae tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1682 microversion: 2.1 time: 0.238885 Aug 23 23:13:41.717387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1494/3015] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:41 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:42.649385 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55615655-fa0b-4473-ac4d-a72b4ee681e2", "name": "network-vif-deleted", "tag": "add96d97-fe96-459b-802e-632e4109bb25"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:42.659964 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:42.660430 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:42.660997 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:42.672408 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] Creating event network-vif-deleted:add96d97-fe96-459b-802e-632e4109bb25 for instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 on hv-cinder-84254 Aug 23 23:13:42.677595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-c4d320f0-9c2b-43db-af1c-4e0d3ab220db req-44864e27-737a-4e5a-ba31-7298e2f98481 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085099 Aug 23 23:13:42.678189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1522/3016] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:42.739410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:42.740116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:42.747004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:42.747600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:42.748136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:42.748866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:42.749428 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:42.749946 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:42.827340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:42.845258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b44f6b13-9cbb-46aa-9343-b0148a669e4b tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1614 microversion: 2.1 time: 0.109127 Aug 23 23:13:42.845963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1495/3017] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:42 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:43.875562 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:43.876294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:43.885486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:43.885486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:43.885486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:43.885486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:43.885904 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:43.886143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:43.919863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:43.920346 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:43.920784 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:43.921259 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'fault' on Instance uuid 55615655-fa0b-4473-ac4d-a72b4ee681e2 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:13:43.966232 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:43.974388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f54f791a-caff-4a30-9731-7e21e1496936 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 200 len: 1331 microversion: 2.1 time: 0.103798 Aug 23 23:13:43.977159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1523/3018] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:43 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:44.996101 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:44.996706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:45.004105 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:45.004581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:45.005052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:45.005777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:45.006231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:45.006654 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:45.020685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 HTTP/1.1 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:13:45.022306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:13:45.023744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '55615655-fa0b-4473-ac4d-a72b4ee681e2'} Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:13:45.024608 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:13:45.026328 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:13:45.027785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:13:45.027785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5594e85e-0d25-4928-8254-49bc9c8dfde1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 404 len: 111 microversion: 2.1 time: 0.032027 Aug 23 23:13:45.027785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1496/3019] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:44 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:13:45.033242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a3606fbb-01ab-44f1-9fc9-43b1ddedc498 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '.version_select at 0x7f5ed0fbe700>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:45.136532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a3606fbb-01ab-44f1-9fc9-43b1ddedc498 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275440094" status: 202 len: 0 microversion: 2.1 time: 0.106604 Aug 23 23:13:45.137057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1524/3020] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 23:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275440094 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:13:46.149988 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-56339c83-ea56-49da-a250-553bc5cb7696 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: .version_select at 0x7f5ed0f4bc10>, body: {"keypair": {"name": "tempest-keypair-881344929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClBuQcqG01I1b4tqs64Bbkvqxvmt03IlJognJGk4qeKJ6ptq5P3epphsz/akH2O0JoGj0qd3/MF8wXDnEXsIcF4eYJSWh4lE068KD6ECKyVw4DjhC6op3K0YOci0TT5sA=="}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:46.167078 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-56339c83-ea56-49da-a250-553bc5cb7696 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:13:46.171052 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-56339c83-ea56-49da-a250-553bc5cb7696 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'key_pairs'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:13:46.308486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-56339c83-ea56-49da-a250-553bc5cb7696 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162369 Aug 23 23:13:46.309215 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1497/3021] 10.222.0.73 () {60 vars in 1159 bytes} [Tue Aug 23 23:13:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:48.732074 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-817363638", "imageRef": "634a90f3-8b65-4e6a-833e-328de093df6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974386b3-3c24-4bb8-8a00-3bab468a71cb"}], "security_groups": [{"name": "tempest-securitygroup--627929434"}], "key_name": "tempest-keypair-881344929", "user_data": "}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:48.838060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] validate_networks() for [('974386b3-3c24-4bb8-8a00-3bab468a71cb', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:13:49.219596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:13:49.220015 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:13:49.220489 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:13:49.220896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:13:49.221330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:13:49.232470 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:49.237625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:49.237625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:49.237625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:49.237625 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:49.237958 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:49.252823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:13:49.256839 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Getting quotas for user b7d2ab8bd072488091fb5a94f59946d3 and project 226fb1c97e3f4e87a47326dae7fb262d. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:13:49.267955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:13:49.270614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='634a90f3-8b65-4e6a-833e-328de093df6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:13:49.430084 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f2809037-2588-4c7d-9477-186b483bb9e1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.702448 Aug 23 23:13:49.430746 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1525/3022] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:13:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:13:49.442844 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-181a75c9-3b4c-480e-941c-c368cb4b29fc tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:49.443496 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-181a75c9-3b4c-480e-941c-c368cb4b29fc tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:49.504423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-181a75c9-3b4c-480e-941c-c368cb4b29fc tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:49.511769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-181a75c9-3b4c-480e-941c-c368cb4b29fc tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1240 microversion: 2.1 time: 0.073333 Aug 23 23:13:49.512422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1498/3023] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:49 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:50.532830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:50.533465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:50.539815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:50.540297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:50.540735 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:50.541449 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:50.542550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:50.542981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:50.610221 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:50.618223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0b37ba4-b950-410b-83e8-c4d7a3179b3a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1244 microversion: 2.1 time: 0.089919 Aug 23 23:13:50.618801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1526/3024] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:50 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:51.152036 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:51.152591 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:51.159316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.159822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.160258 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.160945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.161436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.161862 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.187035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:13:51.568999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-722d55a9-ced5-48c5-8339-451a4561409e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 204 len: 0 microversion: 2.1 time: 0.421377 Aug 23 23:13:51.569834 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1499/3025] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:13:51 2022] DELETE /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:13:51.578884 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:51.579492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:51.585947 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.586419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.586851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.587532 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.587981 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.588402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.640264 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:51.641035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:51.647638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.648134 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.648598 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.652004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:51.652004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:51.652004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:51.717191 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:51.725336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d30f2f8c-fafe-43b5-ab81-44fd191efe88 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1300 microversion: 2.1 time: 0.090337 Aug 23 23:13:51.725908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1500/3026] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:51 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:51.736831 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:51.746496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2a2e05d-5dfc-4a7b-a5a7-8bc3630cfff7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1578 microversion: 2.1 time: 0.170683 Aug 23 23:13:51.747366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1527/3027] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:51 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:52.747039 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:52.747669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:52.754149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:52.754630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:52.755062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:52.755741 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:52.756182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:52.756599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:52.768873 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:52.769585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:52.776366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:52.777869 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:52.778619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:52.779320 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:52.779776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:52.780227 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:52.834159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:52.842639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c3f7f91a-4eed-4925-8e98-5b96e631f6ba tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1310 microversion: 2.1 time: 0.099470 Aug 23 23:13:52.843442 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1501/3028] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:52 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:52.932885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:52.940828 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5d59af37-f042-4fb2-969a-0e820d8144b6 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1578 microversion: 2.1 time: 0.175749 Aug 23 23:13:52.949539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1528/3029] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:52 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:53.865334 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:53.865856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:53.873943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:53.874651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:53.878702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:53.878702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:53.878702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:53.878702 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:53.962776 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:53.965601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:53.975396 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:53.976198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:53.976852 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:53.978473 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:53.979091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:53.979683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:54.101637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:54.113160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2caf91d1-859c-4411-84ec-c44d6208e08d tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.251684 Aug 23 23:13:54.113916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1502/3030] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:53 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:54.226243 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:54.234788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-98beb5c3-b040-4196-9448-2ab6b992687f tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1578 microversion: 2.1 time: 0.276102 Aug 23 23:13:54.237312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1529/3031] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:53 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1578 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:54.687181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced", "tag": "4a2d6c8a-ba58-425b-9e87-195ec0d02306"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:54.703335 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:54.707785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:54.708390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:54.730409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] Creating event network-changed:4a2d6c8a-ba58-425b-9e87-195ec0d02306 for instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced on hv-cinder-84254 Aug 23 23:13:54.740973 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-b5d16e1f-8bce-4232-8a99-f67dce0f79b4 req-ffa88122-6d6e-41f2-9c67-52b3b2342986 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063567 Aug 23 23:13:54.742769 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb0b9d-ac31-476e-8994-feb610f6b831", "name": "network-vif-deleted", "tag": "846b424c-98e3-4079-b697-8a3836407f16"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:54.749347 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1503/3032] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:54.763351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:54.763351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:54.763351 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:54.776220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] Creating event network-vif-deleted:846b424c-98e3-4079-b697-8a3836407f16 for instance 1afb0b9d-ac31-476e-8994-feb610f6b831 on hv-cinder-84254 Aug 23 23:13:54.785851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-10fa8fe3-e361-491f-82ee-b49dd3c0c960 req-1d0c19f0-d35f-41c1-915d-07372714f88b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108099 Aug 23 23:13:54.790734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1530/3033] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:13:55.136709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:55.138004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:55.144925 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:55.145458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:55.154008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:55.154008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:55.154008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:55.154008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:55.260144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:55.261041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:55.269079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:55.270205 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:55.270920 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:55.272021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:55.272723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:55.273383 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:55.305914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:55.314252 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d482fb37-3425-4cb6-9546-d4496e4063eb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.182721 Aug 23 23:13:55.328512 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1504/3034] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:55 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:55.381104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:55.389808 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a79018bd-578e-4dbf-8232-23be7235667b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1226 microversion: 2.1 time: 0.133949 Aug 23 23:13:55.390377 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1531/3035] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:55 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:56.336149 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:56.336676 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:56.343492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:56.344030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:56.344474 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:56.345203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:56.345660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:56.346087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:56.410806 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:56.411423 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:56.413917 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:56.418751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:56.422341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:56.422341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:56.422341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:56.422341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:56.422711 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:56.424017 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:56.454739 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:56.455230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:56.455666 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:56.456114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lazy-loading 'fault' on Instance uuid 1afb0b9d-ac31-476e-8994-feb610f6b831 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:13:56.480567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:56.488810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e810c39a-3938-4d9c-8b43-5ceaeb119b23 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.156769 Aug 23 23:13:56.489424 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1505/3036] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:56 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:56.498101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:56.505655 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4f37d5ff-d5e5-4743-9614-abbf4273c19a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1231 microversion: 2.1 time: 0.098939 Aug 23 23:13:56.506218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1532/3037] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:56 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:57.510808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:57.511584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:57.518073 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:57.518550 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:57.518982 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:57.519669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:57.520114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:57.520535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:57.528130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:57.528827 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:57.536605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:57.537119 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:57.537554 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:57.538250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:57.538723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:57.539150 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:57.572067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:57.572543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:57.572971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:57.573439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lazy-loading 'fault' on Instance uuid 1afb0b9d-ac31-476e-8994-feb610f6b831 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:13:57.619630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:57.628439 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9b3244ba-dc02-412a-9f63-a00abda938f3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 200 len: 1231 microversion: 2.1 time: 0.104785 Aug 23 23:13:57.629046 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1533/3038] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:57 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:57.653162 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:57.659279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1a471b56-406c-4a15-b6c7-0c55e9731524 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.152199 Aug 23 23:13:57.659838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1506/3039] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:57 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:58.649667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:58.650266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:58.657242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:58.657714 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:58.658140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:58.659091 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:58.659565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:58.659976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:58.675612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] HTTP exception thrown: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Request method failure captured: Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 HTTP/1.1 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV5ZCfqYZhuFtUNbwiwJ3p_yflN0bPtF5Fea_CWH7Zdcicir6oxBnhbd-8bQcw8vmaB6hiNyUQWOX8BuwhuqkuC7phEwPVde__-DEZGLaj_S39FpXW9fR4cJEHcXPbrRW9UvQbzfmSHsCbAxV5LbwBT59JNeT8xw5mOCkOKgHqHG1pY Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:13:58.677290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e5fdd0ced9b4bb3af81a136afaca202", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-TestVolumeBootPattern-936931858 Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 51af1e82755e449993e110db493b689b Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:13:58.678534 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '1afb0b9d-ac31-476e-8994-feb610f6b831'} Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:13:58.679326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:13:58.680561 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:13:58.681925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Returning 404 to user: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:13:58.681925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6e692385-7a22-4a46-9adf-b9dce56ef643 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 404 len: 111 microversion: 2.1 time: 0.033266 Aug 23 23:13:58.681925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1534/3040] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:58 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:13:58.682114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:58.682114 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:58.688032 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:58.688520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:58.689062 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:58.689749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:58.690200 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:58.690639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:58.729305 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265707161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067012192", "security_groups": [{"name": "tempest-secgroup-smoke-563255255"}], "block_device_mapping_v2": [{"uuid": "6a006efa-c6b8-4977-bad6-8d16e4a041c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ca01363-48bc-4444-8324-bc3a2c7ab775"}]}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:13:58.832113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:58.841066 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ebac264d-64cf-4d2d-b2d5-35be86a9d410 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.165056 Aug 23 23:13:58.841967 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1507/3041] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:58 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:13:58.854834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.network.neutron [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] validate_networks() for [('4ca01363-48bc-4444-8324-bc3a2c7ab775', None, None, None, None, None)] {{(pid=121884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:13:59.235294 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:13:59.235723 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image limits 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:13:59.236191 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:13:59.236600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image pref 0:0:0 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:13:59.237032 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.virt.hardware [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:13:59.243727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:59.248258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:59.248741 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:59.249220 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:59.249949 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:59.250399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:59.250825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:59.268731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:13:59.272701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.quota [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for user 51af1e82755e449993e110db493b689b and project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:13:59.332035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Going to run 1 instances... {{(pid=121884) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:13:59.334262 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a006efa-c6b8-4977-bad6-8d16e4a041c8',volume_size=None,volume_type=None)] {{(pid=121884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:13:59.731162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-aca7dfd3-3cff-4284-b40b-8e8b0f3fd5cd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.005619 Aug 23 23:13:59.732124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1535/3042] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:13:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:13:59.742795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ac0cf394-31e0-4d40-a430-7b9486c4a166 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:59.743400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ac0cf394-31e0-4d40-a430-7b9486c4a166 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:59.745470 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:59.800750 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-ac0cf394-31e0-4d40-a430-7b9486c4a166 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:13:59.807593 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ac0cf394-31e0-4d40-a430-7b9486c4a166 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1094 microversion: 2.1 time: 0.068731 Aug 23 23:13:59.808266 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1508/3043] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:59 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:13:59.863267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:13:59.863870 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:13:59.870254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:59.872537 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:59.873004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:13:59.873734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:13:59.874193 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:13:59.874619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:00.013298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:00.021111 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ffbdc9eb-79ce-47ca-8224-5856a12fa6fb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.161997 Aug 23 23:14:00.021676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1536/3044] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:13:59 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:00.628181 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced", "name": "network-vif-plugged", "status": "completed", "tag": "4a2d6c8a-ba58-425b-9e87-195ec0d02306"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:00.640059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:00.640545 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:00.640980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:00.644837 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:00.651414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] Creating event network-vif-plugged:4a2d6c8a-ba58-425b-9e87-195ec0d02306 for instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced on hv-cinder-84254 Aug 23 23:14:00.657272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-57cb6744-3477-409e-98a0-591fb0e8a20c req-357c9b5a-72e4-4d4d-81cf-8ed437d6d8ae service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088002 Aug 23 23:14:00.658034 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1509/3045] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:00.828518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:00.829159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:00.835724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:00.836204 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:00.836694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:00.837388 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:00.837846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:00.838266 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:00.899805 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:00.907811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6a3dce55-7222-47c3-a5f4-2a8616dc15b3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1144 microversion: 2.1 time: 0.083857 Aug 23 23:14:00.908375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1537/3046] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:00 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:01.042478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:01.043229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:01.049830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:01.050309 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:01.050773 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:01.051453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:01.051901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:01.052315 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:01.189956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:01.197735 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3626aa2d-a955-45e7-a009-470af066c9b2 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.159442 Aug 23 23:14:01.200961 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1510/3047] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:01 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:01.929005 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:01.929621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:01.936626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:01.937130 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:01.937565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:01.938249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:01.938717 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:01.939133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.000064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:02.007834 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97df1390-bde9-44d4-a243-95515c18a83a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1192 microversion: 2.1 time: 0.082864 Aug 23 23:14:02.008527 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1538/3048] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:01 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:02.016025 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:02.016715 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:02.023340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.023822 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.024255 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.024939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.025426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.025849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.051203 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lazy-loading 'flavor' on Instance uuid a08478b2-c12c-48de-bd22-fd7d7db32876 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:14:02.221058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:02.221668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:02.227661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.228166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.228595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.229375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.229823 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.230238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.360900 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:02.368630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0884ffc0-dcfc-404e-8618-0465c8fb290e tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1365 microversion: 2.1 time: 0.152864 Aug 23 23:14:02.369224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1539/3049] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:02 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:02.568616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-feecfb79-1946-42eb-946e-ffce794f04f5 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "POST /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876/action" status: 202 len: 0 microversion: 2.1 time: 0.557041 Aug 23 23:14:02.569231 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1511/3050] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 23:14:02 2022] POST /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:14:02.579424 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:02.584573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:02.587144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.587993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.588803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.589069 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:02.589588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:02.590104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:02.731054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:02.739417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-f8bb199f-8304-48fb-b906-d6a35dbb5f1f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.165736 Aug 23 23:14:02.739992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1540/3051] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:02 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:03.029056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:03.030056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:03.038150 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.038797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.039237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.039971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.040426 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.040966 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.109244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:03.116900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-b417a1a9-f673-4d57-9ff7-d2f411c12780 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1200 microversion: 2.1 time: 0.092759 Aug 23 23:14:03.117497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1512/3052] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:03 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:03.389701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:03.390309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:03.396845 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.397582 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.398162 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.399020 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.399467 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.399885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.615476 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:03.623927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0a642ae1-9a63-44f0-80ee-e4e68ebeb28a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1555 microversion: 2.1 time: 0.238050 Aug 23 23:14:03.626955 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1541/3053] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:03 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:03.645282 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:03.645778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:03.651719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.652397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.652890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.653571 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.654068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.654482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.736378 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d00a45de-9773-4c54-889e-499ff5750f96 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095198 Aug 23 23:14:03.736995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1513/3054] 10.222.0.73 () {58 vars in 1275 bytes} [Tue Aug 23 23:14:03 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:03.762951 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:03.763885 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:03.770520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.771013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.771445 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:03.772512 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:03.773040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:03.773474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:04.139035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:04.139745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:04.145866 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:04.148099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:04.148099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:04.148099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:04.148099 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:04.148915 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:04.227766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:04.239394 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4c3a9612-f1dd-40b1-aaf0-c9f3694936c4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.481658 Aug 23 23:14:04.240938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1542/3055] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:03 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:04.257703 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:04.266554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4886c61d-8bce-4279-a6b3-e43b07841c27 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1210 microversion: 2.1 time: 0.132310 Aug 23 23:14:04.267229 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1514/3056] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:04 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:04.872230 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced", "tag": "4a2d6c8a-ba58-425b-9e87-195ec0d02306"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:04.882575 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:04.883050 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:04.883619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:04.895340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] Creating event network-changed:4a2d6c8a-ba58-425b-9e87-195ec0d02306 for instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced on hv-cinder-84254 Aug 23 23:14:04.900326 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-dafc7a1f-097b-4fdf-9a7e-a12cd5febc21 req-1cbc6d69-0fb6-4b89-8750-5531c1fe1c79 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032554 Aug 23 23:14:04.901060 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1543/3057] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:05.263721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:05.264972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:05.272171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:05.273627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:05.274293 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:05.275220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:05.275986 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:05.276579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:05.290488 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:05.292058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:05.301668 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:05.305800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:05.306623 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:05.315874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:05.315874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:05.315874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:05.548004 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:05.569574 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e018e5c6-4f78-456b-80de-e2eb6c3041fb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.310610 Aug 23 23:14:05.571511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1515/3058] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:05 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:05.575867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:05.584757 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-93fde156-65c9-467f-98bb-579b4be7d93e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.299304 Aug 23 23:14:05.591634 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1544/3059] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:05 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:05.767726 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d90043-3072-4c05-968e-7bb44f3d5fc6", "tag": "5779d37c-cd9a-40b3-bc52-191a91acdc09"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:05.776874 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:05.777650 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:05.778093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:05.795808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] Creating event network-changed:5779d37c-cd9a-40b3-bc52-191a91acdc09 for instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 on hv-cinder-84254 Aug 23 23:14:05.801117 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-165b0368-6a7e-434c-8818-261dd2e7997c req-43eb607d-fca6-4ba7-af52-bfb2174339a7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040629 Aug 23 23:14:05.801745 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1516/3060] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:06.592506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:06.593142 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:06.599040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:06.599529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:06.599977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:06.600669 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:06.602962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:06.602962 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:06.613306 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:06.614005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:06.615907 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:06.620882 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:06.621931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:06.622369 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:06.623058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:06.623511 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:06.623936 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:06.740331 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:06.749431 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-971c6892-3d72-44e4-97d5-050874fb6e98 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.161356 Aug 23 23:14:06.763154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1545/3061] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:06 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:06.763419 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:06.767878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5dff5ec5-ee11-4b66-a157-dbf3ce4d8c5a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.159333 Aug 23 23:14:06.768481 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1517/3062] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:06 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:07.770477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:07.771086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:07.777977 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:07.778492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:07.778933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:07.779627 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:07.780083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:07.780507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:07.789330 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:07.789953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:07.797171 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:07.797657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:07.798093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:07.798761 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:07.799205 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:07.799622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:07.924697 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:07.932615 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e2ceb426-6b90-4005-af9d-199284c1742d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.165999 Aug 23 23:14:07.942676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1546/3063] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:07 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:07.942996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:07.947304 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e356fe95-f8d5-4f8c-988f-3eb98f454230 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.161886 Aug 23 23:14:07.947867 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1518/3064] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:07 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:08.954867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:08.955474 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:08.962053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:08.962535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:08.962976 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:08.963665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:08.964213 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:08.965224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:08.968348 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:08.968963 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:08.975417 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:08.975906 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:08.976367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:08.977061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:08.977543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:08.977945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:09.103411 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:09.111846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-9e45bc12-2641-4010-a56d-462c4648314d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.160950 Aug 23 23:14:09.112363 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:09.112485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1547/3065] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:08 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:09.119996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fea3fb01-05b9-4fbe-b88f-a9315c4b25d7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.156205 Aug 23 23:14:09.120558 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1519/3066] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:08 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:10.133624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:10.134144 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:10.136105 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=12 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:10.136795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:10.141166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:10.141778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:10.142001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:10.142539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:10.142978 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:10.143656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:10.143758 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:10.144103 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:10.144520 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:10.148863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:10.149446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:10.149887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:10.150584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:10.151043 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:10.151468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:10.285054 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:10.288695 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:10.294767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ba4f586a-a5cd-4590-a673-16e2716631bd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.164730 Aug 23 23:14:10.295354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1548/3067] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:10 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:10.297046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-69ba512c-593b-453c-b38c-188265a38703 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.159727 Aug 23 23:14:10.297748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1520/3068] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:10 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:11.317399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:11.317940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:11.318309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:11.318403 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:11.324460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:11.324886 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:11.325035 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:11.325392 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:11.325497 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:11.325825 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:11.326075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:11.326513 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:11.326657 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:11.326927 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:11.327035 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:11.327359 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:11.460446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:11.463847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:11.468880 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7bc27907-433a-4d5d-984b-86e304de55f2 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.154981 Aug 23 23:14:11.469486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1521/3069] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:11 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:11.472772 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-62de0b16-e259-41e9-9f5c-355a12994655 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.159294 Aug 23 23:14:11.473508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1549/3070] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:11 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:12.490776 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:12.491397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:12.495734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:12.497254 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:12.499057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:12.499467 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:12.499900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:12.500595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:12.501226 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:12.501653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:12.503815 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:12.504301 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:12.504734 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:12.505451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:12.505952 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:12.506332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:12.510416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=100 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:12.639317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:12.646724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:12.647207 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8728c4d1-9620-47df-acab-2e85bd19e7ea tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.160580 Aug 23 23:14:12.647769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1522/3071] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:12 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:12.655309 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-bad0f631-628f-4b79-8a7f-af3141bfbe23 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.163403 Aug 23 23:14:12.655863 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1550/3072] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:12 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:13.669453 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:13.670102 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:13.676042 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:13.676809 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:13.677238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:13.677783 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:13.678243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:13.678965 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:13.679420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:13.679868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:13.683077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:13.683559 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:13.684081 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:13.685846 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:13.686339 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:13.686766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:13.816423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:13.820907 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:13.824081 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-032126d6-a437-4a7e-8689-55148118f473 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.159275 Aug 23 23:14:13.824680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1523/3073] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:13 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:13.829393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-97a4bd78-fb7d-49c7-a7f4-74a05c283449 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.157372 Aug 23 23:14:13.830041 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1551/3074] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:13 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:14.844707 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:14.845364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:14.850674 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:14.851282 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:14.851931 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:14.852405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:14.852840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:14.853554 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:14.854008 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:14.854429 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:14.866685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:14.866685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:14.866685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:14.866685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:14.866953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:14.866953 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:14.991911 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:14.993318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:15.001451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8947b54f-fbf9-4f32-a98b-fe2dd78bf18a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.160945 Aug 23 23:14:15.002038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1524/3075] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:14 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:15.002247 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-d1b23b82-ec1c-47cd-a18c-88f7af79c600 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.155356 Aug 23 23:14:15.005064 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1552/3076] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:14 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:16.022281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:16.022884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:16.023217 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:16.023894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:16.030569 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:16.031072 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:16.031485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:16.031627 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:16.032217 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:16.032325 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:16.032663 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:16.033101 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:16.033214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:16.034601 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:16.035442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:16.036224 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:16.052878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:16.176831 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:16.185075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-94e8e79d-93bf-482e-b742-8007972d84ab tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.166983 Aug 23 23:14:16.185651 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1525/3077] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:16 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:16.187404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:16.195283 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-12031847-4eb0-4634-a940-258219beeaa1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.176201 Aug 23 23:14:16.200313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1553/3078] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:16 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:16.628995 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d90043-3072-4c05-968e-7bb44f3d5fc6", "name": "network-vif-plugged", "status": "completed", "tag": "5779d37c-cd9a-40b3-bc52-191a91acdc09"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:16.638980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:16.639446 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:16.639876 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:16.650827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] Creating event network-vif-plugged:5779d37c-cd9a-40b3-bc52-191a91acdc09 for instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 on hv-cinder-84254 Aug 23 23:14:16.656613 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-807da85c-6dc3-41a5-8c69-5cb18842f2ec req-06abaf89-29a8-463a-932b-9708cf786db0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Aug 23 23:14:16.657232 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1526/3079] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:17.206490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:17.207090 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:17.213465 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:17.213942 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:17.214373 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:17.215057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:17.215719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:17.216148 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:17.221244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:17.221947 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:17.229562 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:17.234316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:17.234316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:17.234316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:17.234316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:17.234653 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:17.357518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:17.365328 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-19dc725f-c587-4be4-ad8c-bcd15b9969f1 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.162874 Aug 23 23:14:17.366079 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1554/3080] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:17 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:17.368500 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:17.377214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-22c70a0e-66c6-47e2-8c47-350e9408f228 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.160654 Aug 23 23:14:17.377772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1527/3081] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:17 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:18.386563 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:18.387306 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:18.395077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.395662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.396173 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.397124 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.397587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.398016 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.398120 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:18.398682 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:18.406720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.407788 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.408237 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.409225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.409685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.410113 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.542242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:18.552766 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-fa137289-df79-42f3-a3d1-0946bc8a0256 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1265 microversion: 2.1 time: 0.170198 Aug 23 23:14:18.553636 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1555/3082] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:18 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:18.566482 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:18.578021 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c93d36b2-8e08-43b7-8073-d1d7228ef798 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1570 microversion: 2.1 time: 0.183623 Aug 23 23:14:18.578722 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1528/3083] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:18 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:14:18.598848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:18.599490 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:18.605464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.606027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.606471 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.607160 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.607611 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.608033 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.653313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121884) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 23:14:18.671681 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "name": "network-vif-unplugged", "status": "completed", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:18.681259 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:18.681768 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:18.682170 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:18.694155 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.compute.server_external_events [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] Unable to find a host for instance a08478b2-c12c-48de-bd22-fd7d7db32876. Dropping event network-vif-unplugged {{(pid=121885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 23:14:18.695061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-4d6e7a8e-7341-4e34-9819-edeceada9329 req-55a929ce-1fb7-4748-8f5b-5284f58b265d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028130 Aug 23 23:14:18.695636 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1529/3084] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 23:14:18.993492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-2e9cb7e2-a6af-4b17-b847-b1d6456d75f6 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "POST /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876/action" status: 202 len: 0 microversion: 2.1 time: 0.398627 Aug 23 23:14:18.994114 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1556/3085] 10.222.0.73 () {60 vars in 1278 bytes} [Tue Aug 23 23:14:18 2022] POST /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:14:19.002841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:19.003450 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:19.009435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.009914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.010342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.011048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.011493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.011913 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.156079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:19.164405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3ad6a5bd-5314-4af8-b394-0ee30ffa089d tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1518 microversion: 2.1 time: 0.166037 Aug 23 23:14:19.165068 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1530/3086] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:18 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:19.575969 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:19.577549 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:19.583654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.584136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.584569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.585298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.585764 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.586249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.720771 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:19.728485 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b6eb3a7a-ecec-4bc0-bb1b-5dcd6f84c60c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1452 microversion: 2.1 time: 0.157022 Aug 23 23:14:19.729059 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1557/3087] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:19 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:19.748877 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:19.749771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:19.756001 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.756486 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.756919 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.757638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:19.758087 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:19.758509 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:19.897333 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:19.905433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5022ec6f-f6b3-43ce-baf8-c44a9e5b66a7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1452 microversion: 2.1 time: 0.160280 Aug 23 23:14:19.906151 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1531/3088] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:19 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:20.187686 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:20.188292 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:20.194654 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:20.195195 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:20.195837 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:20.196539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:20.197004 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:20.197492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:20.347781 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:20.356307 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-7eadc646-fa66-4978-a211-4166b4baf914 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1518 microversion: 2.1 time: 0.173149 Aug 23 23:14:20.356882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1558/3089] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:20 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:21.378979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:21.379578 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:21.386272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:21.386956 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:21.387622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:21.388358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:21.388817 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:21.389288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:21.560698 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:21.571273 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4bf1e5d6-c0a3-454f-ad55-5788aef25667 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1520 microversion: 2.1 time: 0.196640 Aug 23 23:14:21.571972 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1532/3090] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:21 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:22.274644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d90043-3072-4c05-968e-7bb44f3d5fc6", "tag": "5779d37c-cd9a-40b3-bc52-191a91acdc09"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:22.286364 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:22.287184 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:22.287819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:22.300844 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] Creating event network-changed:5779d37c-cd9a-40b3-bc52-191a91acdc09 for instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 on hv-cinder-84254 Aug 23 23:14:22.307440 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-59123522-2bcb-4e06-afc1-0c2eac61753c req-01ca8769-d53b-419f-a477-6f43350132a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036537 Aug 23 23:14:22.308057 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1559/3091] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:14:22.593667 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:22.594894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:22.601532 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:22.602343 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:22.602778 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:22.603564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:22.604508 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:22.604954 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:22.815061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:22.832421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-7be4bc16-6a57-4502-a597-3cc5bb49d17f tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.243268 Aug 23 23:14:22.833920 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1533/3092] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:22 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:23.855689 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:23.856580 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:23.863874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:23.864354 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:23.864788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:23.865516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:23.865972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:23.866397 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:23.997330 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:24.005438 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-68e36119-8c3c-47c4-895a-91dc2bb41c5a tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.154609 Aug 23 23:14:24.006040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1560/3093] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:23 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:25.027160 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:25.027795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:25.035090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:25.035573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:25.036006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:25.036688 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:25.037166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:25.037587 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:25.169161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:25.177579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-23d8d201-953a-4652-bdf9-17e8eeda85d3 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.154354 Aug 23 23:14:25.178144 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1534/3094] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:25 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:26.198998 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:26.199621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:26.206775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:26.207260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:26.207701 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:26.208404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:26.208859 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:26.209342 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:26.345621 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:26.354189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a623f0bd-1818-44a1-b9bf-bc25879c009e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.159307 Aug 23 23:14:26.354767 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1561/3095] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:26 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:27.375687 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:27.376631 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:27.383225 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:27.383709 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:27.384146 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:27.384830 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:27.385336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:27.385757 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:27.524002 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:27.531856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c1016e3c-6f18-424a-bac2-4fe66c22a7bb tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.160106 Aug 23 23:14:27.532407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1535/3096] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:27 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:28.554242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:28.554865 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:28.561905 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:28.562384 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:28.562811 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:28.563492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:28.563933 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:28.564350 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:28.697460 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:28.705025 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-1ce641e9-cffd-42cd-a52e-f5109c417149 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.155247 Aug 23 23:14:28.705606 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1562/3097] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:28 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:29.726269 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:29.727031 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:29.733435 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:29.733924 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:29.734360 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:29.735055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:29.735517 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:29.735939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:29.870945 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:29.879639 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3355bad0-5ae6-42ee-ae6c-b41c9ba97bdd tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.156436 Aug 23 23:14:29.880286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1536/3098] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:29 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:30.900913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:30.901550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:30.904170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:30.908848 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:30.910214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:30.910630 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:30.911319 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:30.911801 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:30.918924 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:31.046882 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:31.055472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-58fa223d-e3db-453d-9134-b25ab2d11ff8 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.158488 Aug 23 23:14:31.056143 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1563/3099] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:30 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:32.076978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:32.077664 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:32.084589 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:32.085112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:32.085552 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:32.086238 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:32.086737 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:32.087163 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:32.225980 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:32.233987 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-fcd11f2d-3584-46ae-8877-c7baaa033001 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.161096 Aug 23 23:14:32.234549 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1537/3100] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:32 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:33.256595 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:33.257250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:33.264023 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:33.264516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:33.264961 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:33.265684 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:33.266147 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:33.266568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:33.411315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:33.418982 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b0e93d76-cc72-4103-9fa3-b0e45e0da3e9 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.166941 Aug 23 23:14:33.419539 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1564/3101] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:33 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:34.439705 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:34.440314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:34.447674 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:34.448136 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:34.448566 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:34.449286 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:34.449746 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:34.450169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:34.585782 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:34.587867 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "name": "network-vif-plugged", "status": "completed", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:14:34.593970 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-1c796952-f575-4639-8f83-76abba7b151c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.158069 Aug 23 23:14:34.594840 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1538/3102] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:34 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:34.602145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:34.602619 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:34.603052 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:34.615311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] Creating event network-vif-plugged:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:14:34.621083 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-b56ca359-233a-4acf-91a6-388a46339ed5 req-396291b4-d332-43a8-85d5-ef253cd00859 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037430 Aug 23 23:14:34.622308 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1565/3103] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:14:35.614748 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:35.615364 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:35.621943 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:35.622430 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:35.622871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:35.623684 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:35.624139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:35.624564 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:35.761570 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:35.769929 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-76d55a3e-a9bc-4318-86f1-86ba0a02667e tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1576 microversion: 2.1 time: 0.158472 Aug 23 23:14:35.770498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1539/3104] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:35 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:14:36.792180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:14:36.792874 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:14:36.799535 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:36.800040 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:36.800643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:36.801511 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:14:36.802006 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:14:36.802454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:14:36.939498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:14:36.948321 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4e1f76e6-a225-4fb0-b24c-ae4bfb64080c tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1563 microversion: 2.1 time: 0.160432 Aug 23 23:14:36.951403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1566/3105] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:14:36 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:15:31.591456 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:31.592019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:31.594322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=45 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.595048 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=78 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.599829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:31.600317 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:31.600756 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:31.601480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:31.601984 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:31.602416 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:31.625329 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-ce5055e4-66c2-45af-b9f2-f78b269e18f4 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/ips" status: 200 len: 149 microversion: 2.1 time: 0.038499 Aug 23 23:15:31.625901 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1540/3106] 10.222.0.73 () {58 vars in 1248 bytes} [Tue Aug 23 23:15:31 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:15:34.254851 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d6aec84-f92c-4cf2-a1cb-bef3e9cb7ae7"}} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:15:34.257201 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:34.260223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=7 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:34.260899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:34.265656 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:34.266133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:34.266565 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:34.267250 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:34.267704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:34.268128 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:35.225169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd035a1a-2e0e-46e2-b0a5-61152b5f86d7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "POST /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974247 Aug 23 23:15:35.225993 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1567/3107] 10.222.0.73 () {60 vars in 1323 bytes} [Tue Aug 23 23:15:34 2022] POST /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments => generated 194 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:15:43.918188 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:43.918811 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:43.926239 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:43.926727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:43.927159 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:43.927856 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:43.928307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:43.928727 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:44.010030 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lazy-loading 'services' on Instance uuid a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:15:44.238246 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-60f2886c-c4b0-4275-a829-5f1fe83ad069 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments/2d6aec84-f92c-4cf2-a1cb-bef3e9cb7ae7" status: 202 len: 0 microversion: 2.1 time: 0.324628 Aug 23 23:15:44.238849 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1541/3108] 10.222.0.73 () {58 vars in 1416 bytes} [Tue Aug 23 23:15:43 2022] DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments/2d6aec84-f92c-4cf2-a1cb-bef3e9cb7ae7 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:15:44.248437 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:44.250819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:44.257496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:44.257973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:44.258402 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:44.259155 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:44.259605 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:44.260019 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:44.292521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ead5411b-0781-4478-93c3-7eda45d114f5 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Aug 23 23:15:44.293170 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1568/3109] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:15:44 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:15:45.307899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:45.310898 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:45.317292 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:45.317804 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:45.318243 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:45.318937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:45.319387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:45.319812 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:45.358193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e0ca813f-300f-49d4-8f76-9601234dbbeb tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054200 Aug 23 23:15:45.359164 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1542/3110] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:15:45 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:15:46.374139 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:46.376277 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:46.382896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.383404 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.383819 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:46.384680 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.385028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.385453 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:46.415334 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-6aa2ac40-bd4c-41d3-8e45-dd0827f73607 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045870 Aug 23 23:15:46.415893 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1569/3111] 10.222.0.73 () {58 vars in 1302 bytes} [Tue Aug 23 23:15:46 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 23:15:46.482774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:46.482774 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:46.486090 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.486584 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.487029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:46.487884 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.488340 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.488765 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:46.514914 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:15:46.878690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e76a1f91-de32-4ebe-94a7-1102837c6ff7 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 204 len: 0 microversion: 2.1 time: 0.404133 Aug 23 23:15:46.879209 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1543/3112] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:15:46 2022] DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:15:46.893890 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:46.894501 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:46.900660 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.901187 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.901651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:46.902393 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:46.902908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:46.903386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:47.039509 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:15:47.047861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0b27d7e1-2134-4850-b512-9a3c0486463a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1679 microversion: 2.1 time: 0.157943 Aug 23 23:15:47.055521 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1570/3113] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:46 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:15:48.069772 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:48.070535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:48.077407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:48.077887 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:48.078320 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:48.078997 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:48.079478 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:48.079893 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:48.216373 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:15:48.219978 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f8290338-88f6-4e01-b2c1-a2ccbf05ace8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1679 microversion: 2.1 time: 0.154360 Aug 23 23:15:48.220557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1544/3114] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:48 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:15:49.240642 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:49.241304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:49.247830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:49.248316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:49.248751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:49.249478 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:49.249935 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:49.250362 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:49.384121 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:15:49.392572 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a998c853-4565-45f8-a5f7-4d93b173ec81 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1679 microversion: 2.1 time: 0.155908 Aug 23 23:15:49.393163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1571/3115] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:49 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:15:50.144881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced", "name": "network-vif-deleted", "tag": "4a2d6c8a-ba58-425b-9e87-195ec0d02306"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:15:50.155605 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:50.156250 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:50.158046 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:50.168641 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] Creating event network-vif-deleted:4a2d6c8a-ba58-425b-9e87-195ec0d02306 for instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced on hv-cinder-84254 Aug 23 23:15:50.174630 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-900cd0f7-c176-4689-b681-8dcd3381d7c3 req-cd4dee18-f1dd-478c-8cd3-11886f79a190 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 23 23:15:50.175271 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1545/3116] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:15:50.415133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:50.415685 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:50.422733 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:50.423216 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:50.423651 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:50.424344 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:50.424791 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:50.425318 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:50.492039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d2ab8bd072488091fb5a94f59946d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226fb1c97e3f4e87a47326dae7fb262d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:15:50.500518 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-afd4b7e5-daed-4845-a7af-05213372280c tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 200 len: 1325 microversion: 2.1 time: 0.089403 Aug 23 23:15:50.501472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1572/3117] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:50 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 23:15:51.523074 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:51.523760 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:51.530367 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:51.530838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:51.531268 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:51.531939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:51.532384 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:51.532797 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:51.546196 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced HTTP/1.1 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:15:51.551879 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:51.553307 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced'} Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:51.554153 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:51.555622 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:51.556900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:51.556900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-906af62b-e30c-446b-b3f3-014361654297 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 404 len: 111 microversion: 2.1 time: 0.030386 Aug 23 23:15:51.556900 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1546/3118] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:51 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:51.561163 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0a87c0ee-3de1-4232-80f7-582f9d0be621 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '.version_select at 0x7f5ed0da4af0>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:51.690304 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0a87c0ee-3de1-4232-80f7-582f9d0be621 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881344929" status: 202 len: 0 microversion: 2.1 time: 0.134566 Aug 23 23:15:51.691021 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1573/3119] 10.222.0.73 () {58 vars in 1218 bytes} [Tue Aug 23 23:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881344929 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:15:53.937992 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:53.938494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:53.945017 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:53.945528 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:53.945958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:53.946632 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:53.947076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:53.947490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:53.960787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced HTTP/1.1 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:15:53.962388 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.963785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced'} Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:53.964596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.965754 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:53.966923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:53.966923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-3f10f826-fe8c-4efc-ac50-8cd4661d2b21 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 404 len: 111 microversion: 2.1 time: 0.030274 Aug 23 23:15:53.966923 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1547/3120] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:15:53 2022] DELETE /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:53.972446 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:53.973072 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:53.980316 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:53.980825 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:53.981317 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:53.982452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:53.982896 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:53.983507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:53.996911 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced HTTP/1.1 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:15:53.999273 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:54.000742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced'} Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:54.001543 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. Aug 23 23:15:54.002899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:54.004206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:54.004206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-78870093-f913-4c99-99a2-4a5fa93a5ec0 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced" status: 404 len: 111 microversion: 2.1 time: 0.032036 Aug 23 23:15:54.004206 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1574/3121] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:53 2022] GET /compute/v2.1/servers/a84fe8fc-d0ac-4ffe-85ea-d47bfd7f0ced => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:55.279742 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:55.280228 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:55.286894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.287375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.287810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.288498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.288955 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.289407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.303093 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 HTTP/1.1 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:15:55.304628 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.306077 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '55615655-fa0b-4473-ac4d-a72b4ee681e2'} Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:55.306749 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.308107 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.309658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:55.309658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0f39d197-1944-4716-bb1a-0b936d5db233 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 404 len: 111 microversion: 2.1 time: 0.030957 Aug 23 23:15:55.309658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1548/3122] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:15:55 2022] DELETE /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:55.315583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:55.316194 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 55615655-fa0b-4473-ac4d-a72b4ee681e2] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:55.322818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.323302 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.323738 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.324450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.324881 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.325332 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.339435 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 HTTP/1.1 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:15:55.340939 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.342729 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '55615655-fa0b-4473-ac4d-a72b4ee681e2'} Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:55.343550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. Aug 23 23:15:55.344934 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.346265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 55615655-fa0b-4473-ac4d-a72b4ee681e2 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:55.346265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-0d5c8e18-926f-4848-94c1-43815de01df3 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2" status: 404 len: 111 microversion: 2.1 time: 0.031009 Aug 23 23:15:55.346265 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1575/3123] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:55 2022] GET /compute/v2.1/servers/55615655-fa0b-4473-ac4d-a72b4ee681e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:55.350800 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:55.351480 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:55.357937 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.358418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.358855 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.359543 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.359996 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.360420 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.374353 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 HTTP/1.1 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:15:55.375885 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.377451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'b6b6ebc7-2d73-4bb1-a380-b83a3a6be834'} Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:55.378210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.379600 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.380989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:55.380989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d2030891-74d5-4867-81c5-30736beeaec8 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 404 len: 111 microversion: 2.1 time: 0.030264 Aug 23 23:15:55.380989 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1549/3124] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:15:55 2022] DELETE /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:55.386166 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:55.386777 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: b6b6ebc7-2d73-4bb1-a380-b83a3a6be834] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:55.394236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.394754 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.395172 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.395876 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:55.396345 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:55.396751 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:55.411028 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 HTTP/1.1 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:15:55.412550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.413991 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': 'b6b6ebc7-2d73-4bb1-a380-b83a3a6be834'} Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:55.414796 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. Aug 23 23:15:55.416077 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:55.417260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:55.417260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-51cfc11a-351f-4125-80fa-23426e109aa1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834" status: 404 len: 111 microversion: 2.1 time: 0.032071 Aug 23 23:15:55.417260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1576/3125] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:55 2022] GET /compute/v2.1/servers/b6b6ebc7-2d73-4bb1-a380-b83a3a6be834 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:56.726719 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:56.727223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:56.733730 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:56.734220 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:56.734657 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:56.735387 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:56.735841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:56.736276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:56.752361 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 HTTP/1.1 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:15:56.764061 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.765637 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '7fa78a5b-a84b-4b0f-895f-73bba0ed5810'} Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:56.766546 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.767899 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.769423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:56.769423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-8ea7b1a4-ac80-4736-b040-2302be09a8a1 tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 404 len: 111 microversion: 2.1 time: 0.032535 Aug 23 23:15:56.769423 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1550/3126] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:15:56 2022] DELETE /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:15:56.770624 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:15:56.771228 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] [instance: 7fa78a5b-a84b-4b0f-895f-73bba0ed5810] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:15:56.777731 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:56.778203 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:56.778631 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:56.779442 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:15:56.779925 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:15:56.780341 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:15:56.793748 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] HTTP exception thrown: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Request method failure captured: Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 HTTP/1.1 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV2mz_IxNGbbZDGwtXgeHHsdjhGZwfEBDH6xsjJE3D8pWLoDuk_iO9GPGOhqYs-Ozvj0TyF8USSNFeKnMvhtS_FUJYnerCREgCmSO63JYlYqwHrK69sETAdXz522kLWVjVnbb9rTRcabRYIvOmO3O1HeOvfFnJrzIFWjB8GgwzsGs44 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:15:56.795403 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/226fb1c97e3f4e87a47326dae7fb262d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_226fb1c97e3f4e87a47326dae7fb262d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 226fb1c97e3f4e87a47326dae7fb262d Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1668387472 Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: b7d2ab8bd072488091fb5a94f59946d3 Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-AttachVolumeNegativeTest-1668387472-project Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.799744 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '7fa78a5b-a84b-4b0f-895f-73bba0ed5810'} Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:15:56.800568 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. Aug 23 23:15:56.801983 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:15:56.803610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] Returning 404 to user: Instance 7fa78a5b-a84b-4b0f-895f-73bba0ed5810 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:15:56.803610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-75fcc371-4a4c-422b-a66b-cb212c8bf82a tempest-AttachVolumeNegativeTest-1668387472 tempest-AttachVolumeNegativeTest-1668387472-project] 10.222.0.73 "GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810" status: 404 len: 111 microversion: 2.1 time: 0.030012 Aug 23 23:15:56.803610 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1577/3127] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:15:56 2022] GET /compute/v2.1/servers/7fa78a5b-a84b-4b0f-895f-73bba0ed5810 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:16:15.435792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:16:15.436412 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:16:16.076981 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:16.077529 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:16.080084 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:16.080272 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:16:16.080869 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:16.085821 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:16.086311 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:16.087178 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:16.087890 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:16.088342 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:16.088842 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:16.088974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:16.089707 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:16.096600 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:16.099992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:16.099992 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:16.115548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] Creating event network-changed:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:16:16.120405 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:16:16.122569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-f65ad12f-4838-4230-89a1-a8a96e7c8185 req-5e8dc68d-30bc-4b8c-a368-1c650dff8fd5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047012 Aug 23 23:16:16.123603 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1578/3128] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:16:16.502187 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-16a05cee-bd70-4503-818c-0ab5866cebb4 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 204 len: 0 microversion: 2.1 time: 0.428968 Aug 23 23:16:16.502863 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1551/3129] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:16:16 2022] DELETE /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:16:16.512290 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:16.522529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:16.522529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:16.522529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:16.522529 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:16.523070 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:16.523671 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:16.524278 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:16.693417 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:16.701361 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-adabcb08-0229-4b00-9cc7-b7ae1d9409d1 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.193566 Aug 23 23:16:16.709189 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1579/3130] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:16 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:17.723567 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:17.724298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:17.732069 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:17.732563 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:17.732998 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:17.734281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:17.734793 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:17.735224 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:17.919498 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:17.928502 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-5931fc65-bbdd-4b92-a0bb-bb46bbbcc77b tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1569 microversion: 2.1 time: 0.209163 Aug 23 23:16:17.929095 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1552/3131] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:17 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:18.950152 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:18.951661 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:18.960753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:18.961596 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:18.962039 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:18.962755 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:18.963218 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:18.963632 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:19.111855 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:19.120375 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4c157c81-a99a-4c89-b0f3-06ce4ff09a89 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1451 microversion: 2.1 time: 0.174271 Aug 23 23:16:19.120945 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1580/3132] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:18 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:19.237027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478b2-c12c-48de-bd22-fd7d7db32876", "name": "network-vif-deleted", "tag": "5857c7c1-ff2d-400c-b54f-f4587594a9a8"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:16:19.247223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:19.247795 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:19.248351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:19.261479 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] Creating event network-vif-deleted:5857c7c1-ff2d-400c-b54f-f4587594a9a8 for instance a08478b2-c12c-48de-bd22-fd7d7db32876 on hv-cinder-84254 Aug 23 23:16:19.267599 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-ade6bc04-5e4a-4fc6-88d6-ec78247ab310 req-06b8df10-b2ec-4957-bf20-4a056c106e52 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Aug 23 23:16:19.268451 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1553/3133] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 23:16:20.141897 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:20.142507 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:20.148941 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:20.149533 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:20.149980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:20.150662 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:20.151104 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:20.151516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:20.186219 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:20.186708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:20.187643 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:20.188095 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lazy-loading 'fault' on Instance uuid a08478b2-c12c-48de-bd22-fd7d7db32876 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:16:20.229548 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf49a1b3de0478a939694287535607f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51baae7e1f4d318a3c9607d5cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:20.237665 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3e6f6257-dbe1-4304-8084-f3f9f58504ca tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 200 len: 1225 microversion: 2.1 time: 0.100262 Aug 23 23:16:20.238242 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1581/3134] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:20 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:21.266700 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:21.267414 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] [instance: a08478b2-c12c-48de-bd22-fd7d7db32876] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:21.273638 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:21.274116 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:21.274544 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:21.275223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:21.275669 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:21.276085 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:21.290383 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] HTTP exception thrown: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Request method failure captured: Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 HTTP/1.1 Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV5bznmkrYxtjMTKWd6x-psoSC45Ob3-STLw9xUkCZarTqEKdhbOz08M6adiit4y-fFFRrSbR2v7rDjRwyBUldRc7hdDfTZjpahlIUxCEvm3cqGCXZ-Pg4jrvI4xOQ70sIe6YbFIjid1J524xoXfNF8xHkCjMa-0PPfvM0GiJ58uj4Q Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: aa51baae7e1f4d318a3c9607d5cb715d Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-TestShelveInstance-525331578 Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:16:21.292314 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aa51baae7e1f4d318a3c9607d5cb715d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/aa51baae7e1f4d318a3c9607d5cb715d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/aa51baae7e1f4d318a3c9607d5cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_aa51baae7e1f4d318a3c9607d5cb715d", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-TestShelveInstance-525331578 Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: aa51baae7e1f4d318a3c9607d5cb715d Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-TestShelveInstance-525331578 Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-TestShelveInstance-525331578-project Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: daf49a1b3de0478a939694287535607f Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-TestShelveInstance-525331578-project Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. Aug 23 23:16:21.298908 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'a08478b2-c12c-48de-bd22-fd7d7db32876'} Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:16:21.300301 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. Aug 23 23:16:21.301827 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:16:21.303054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Returning 404 to user: Instance a08478b2-c12c-48de-bd22-fd7d7db32876 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:16:21.303054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-6e9fffda-5557-4dd9-bb68-56036e9c1a26 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876" status: 404 len: 111 microversion: 2.1 time: 0.032489 Aug 23 23:16:21.303054 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1554/3135] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:21 2022] GET /compute/v2.1/servers/a08478b2-c12c-48de-bd22-fd7d7db32876 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:16:21.542427 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ae2083cc-e5d6-425a-a764-74d399416ad2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] Calling method '.version_select at 0x7f5ed0dbca60>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:21.651678 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ae2083cc-e5d6-425a-a764-74d399416ad2 tempest-TestShelveInstance-525331578 tempest-TestShelveInstance-525331578-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1465176111" status: 202 len: 0 microversion: 2.1 time: 0.113083 Aug 23 23:16:21.652260 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1582/3136] 10.222.0.73 () {58 vars in 1254 bytes} [Tue Aug 23 23:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1465176111 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:16:43.949810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1207935416", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1067012192", "security_groups": [{"name": "tempest-secgroup-smoke-563255255"}], "block_device_mapping_v2": [{"uuid": "b499a63e-63d3-4171-b1b8-adc0bdcb435f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ca01363-48bc-4444-8324-bc3a2c7ab775"}]}} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:16:43.961940 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:43.962582 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:44.077284 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.network.neutron [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] validate_networks() for [('4ca01363-48bc-4444-8324-bc3a2c7ab775', None, None, None, None, None)] {{(pid=121885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 23:16:44.574019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 23:16:44.574019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image limits 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 23:16:44.574019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Flavor pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 23:16:44.574019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Image pref 0:0:0 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 23:16:44.574019 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.virt.hardware [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 23:16:44.581679 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:44.582167 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:44.582594 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:44.583346 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:44.583798 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:44.584227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:44.601279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 23:16:44.605210 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.quota [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Getting quotas for user 51af1e82755e449993e110db493b689b and project 9e5fdd0ced9b4bb3af81a136afaca202. Resources: {'instances', 'cores', 'ram'} {{(pid=121885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 23:16:44.664411 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Going to run 1 instances... {{(pid=121885) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 23:16:44.666720 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b499a63e-63d3-4171-b1b8-adc0bdcb435f',volume_size=None,volume_type=None)] {{(pid=121885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 23:16:45.264392 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-41a2089d-6d9b-41c6-9d5e-f25120820a32 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.318581 Aug 23 23:16:45.265193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1555/3137] 10.222.0.73 () {60 vars in 1147 bytes} [Tue Aug 23 23:16:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 23:16:45.273742 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=22 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:45.274522 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:45.278340 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-e98ecea1-9df4-4594-963f-e4b9a28b5b1d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:45.278940 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-e98ecea1-9df4-4594-963f-e4b9a28b5b1d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:45.339950 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-e98ecea1-9df4-4594-963f-e4b9a28b5b1d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:45.346879 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-e98ecea1-9df4-4594-963f-e4b9a28b5b1d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1095 microversion: 2.1 time: 0.074616 Aug 23 23:16:45.347452 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1583/3138] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:45 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:46.368327 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:46.368939 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:46.375459 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:46.375976 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:46.376409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:46.377130 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:46.377581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:46.377999 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:46.440009 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:46.448693 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-81111184-bb99-42c0-9db4-ef0565f3b42a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1145 microversion: 2.1 time: 0.084534 Aug 23 23:16:46.449300 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1556/3139] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:46 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:47.471557 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:47.472795 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:47.480284 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:47.480762 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:47.481287 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:47.481971 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:47.482419 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:47.482968 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:47.552894 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:47.563133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-5f33e07a-2a4b-4269-bb7b-6002bdd133da tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1201 microversion: 2.1 time: 0.095875 Aug 23 23:16:47.563644 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1584/3140] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:47 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:48.583808 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:48.585056 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:48.591596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:48.597390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:48.597390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:48.597390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:48.597390 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:48.597771 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:48.835233 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:48.843029 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-0f87c5da-386d-4cb8-9908-1df8904c67ce tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1278 microversion: 2.1 time: 0.263078 Aug 23 23:16:48.849404 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1557/3141] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:48 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:49.467787 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1937f812-8e5b-4c12-bf20-29981bf22a99", "tag": "ac7f80ee-1d0e-47cd-a979-27f787654922"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:16:49.478313 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:49.478749 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:49.479175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:49.495847 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] Creating event network-changed:ac7f80ee-1d0e-47cd-a979-27f787654922 for instance 1937f812-8e5b-4c12-bf20-29981bf22a99 on hv-cinder-84254 Aug 23 23:16:49.504698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-e717ef2f-f74c-4c76-a19b-67b8b482f759 req-a772cf91-cad2-4ab7-9fef-66d1730c1349 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036752 Aug 23 23:16:49.504698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1585/3142] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:16:49.864573 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:49.865281 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:49.871964 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:49.872466 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:49.872881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:49.873624 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:49.874079 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:49.874533 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:50.078088 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:50.086666 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-db7d7f84-c442-4dd5-958f-56b2c379fca0 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.225951 Aug 23 23:16:50.087433 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1558/3143] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:49 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:51.108286 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:51.109116 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:51.116607 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:51.117140 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:51.117573 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:51.118249 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:51.118696 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:51.119107 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:51.253683 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:51.261544 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-eb319976-014d-4316-ac4f-2629b57d7b1e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.157545 Aug 23 23:16:51.262115 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1586/3144] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:51 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:52.282968 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:52.283649 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:52.290457 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:52.290942 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:52.291418 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:52.292140 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:52.292595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:52.293038 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:52.426660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:52.434514 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-d54f931d-3656-48cf-994b-e9795e03dcdd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.155432 Aug 23 23:16:52.435076 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1559/3145] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:52 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:53.456058 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:53.456667 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:53.463291 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:53.463775 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:53.464214 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:53.464899 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:53.465380 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:53.465803 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:53.599067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:53.607099 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-3c1d921a-333a-4e0a-869e-213821442371 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.154884 Aug 23 23:16:53.607676 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1587/3146] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:53 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:54.628005 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:54.628619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:54.630934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=2 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:54.631969 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell0:SELECT=6 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:54.636836 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:54.637349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:54.637785 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:54.638468 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:54.638926 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:54.639349 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:54.775194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:54.783059 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-4385cc2b-c178-4f46-ac1c-d3ef0f04ebed tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.158887 Aug 23 23:16:54.783623 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1560/3147] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:54 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:55.805919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:55.806523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:55.809027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell0:SELECT=2 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:55.813736 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:55.814270 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:55.814694 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:55.815363 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:55.815807 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:55.816223 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:55.949640 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:55.957517 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-db1ac6d2-85f4-4598-9b83-d3df84fadafd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.156163 Aug 23 23:16:55.958088 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1588/3148] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:55 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:56.978058 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:56.978708 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:56.985579 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:56.986067 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:56.986510 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:56.987195 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:56.987721 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:56.988145 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:57.119182 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:57.126934 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-177bbc2d-edcf-42c7-a3ae-77b4b68f2f2d tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.153283 Aug 23 23:16:57.127492 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1561/3149] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:56 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:58.149477 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:58.150008 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:58.151809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:16:58.152251 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:16:58.156597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:58.157171 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:58.157588 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:58.158285 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:58.158719 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:58.159136 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:58.295238 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:58.302895 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b7997d55-171a-4fa3-8c64-51c672c0dadd tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.157613 Aug 23 23:16:58.304295 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1589/3150] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:58 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:16:59.325272 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:16:59.326096 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:16:59.332472 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:59.332951 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:59.333422 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:59.334109 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:16:59.335169 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:16:59.335691 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:16:59.470027 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:16:59.477769 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2229ad43-7d1e-405d-983a-982e411e97f9 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.156501 Aug 23 23:16:59.478322 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1562/3151] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:16:59 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:00.072145 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1937f812-8e5b-4c12-bf20-29981bf22a99", "name": "network-vif-plugged", "status": "completed", "tag": "ac7f80ee-1d0e-47cd-a979-27f787654922"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:17:00.081830 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:00.082310 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:00.082743 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:00.094569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] Creating event network-vif-plugged:ac7f80ee-1d0e-47cd-a979-27f787654922 for instance 1937f812-8e5b-4c12-bf20-29981bf22a99 on hv-cinder-84254 Aug 23 23:17:00.099708 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-23004606-78ca-4c04-9043-90ce582522b1 req-13d2ca1a-3b49-4981-99fb-dbe74a59d6c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032347 Aug 23 23:17:00.101236 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1590/3152] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:17:00.498777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:17:00.499597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:17:00.506112 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:00.506777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:00.507223 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:00.507953 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:00.508407 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:00.508829 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:00.656490 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:17:00.661298 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f70872e8-c0d1-40c7-818d-7cdcf8fc1ea7 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.166370 Aug 23 23:17:00.661865 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1563/3153] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:17:00 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:01.683571 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:17:01.684267 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:17:01.690816 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:01.691297 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:01.691732 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:01.692416 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:01.692866 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:01.693335 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:01.829126 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:17:01.838053 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-ecb5c944-fdf7-4a43-9116-ee837c1b231b tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1266 microversion: 2.1 time: 0.158798 Aug 23 23:17:01.838620 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1591/3154] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:17:01 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:02.859126 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:17:02.859660 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:17:02.866294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:02.867358 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:02.867820 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:02.868520 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:02.868974 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:02.869421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:03.002905 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:17:03.010810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-16a46213-a7f8-427e-a168-bdecdef49fad tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1453 microversion: 2.1 time: 0.155612 Aug 23 23:17:03.012047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1564/3155] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:17:02 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:03.031496 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:17:03.032102 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:17:03.039198 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:03.039687 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:03.040122 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:03.040800 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:03.041280 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:03.041704 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:03.175908 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:17:03.184001 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-c2f53ea3-e6d0-4145-adb5-cdd8086c68cc tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1453 microversion: 2.1 time: 0.156324 Aug 23 23:17:03.184569 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1592/3156] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:17:03 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:05.266833 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1937f812-8e5b-4c12-bf20-29981bf22a99", "tag": "ac7f80ee-1d0e-47cd-a979-27f787654922"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:17:05.277161 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:17:05.277696 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:17:05.278111 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:17:05.289810 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] Creating event network-changed:ac7f80ee-1d0e-47cd-a979-27f787654922 for instance 1937f812-8e5b-4c12-bf20-29981bf22a99 on hv-cinder-84254 Aug 23 23:17:05.295006 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-dd1dcc92-af92-4755-b389-e99246a5b567 req-b26ee15a-9e3b-42fc-9b09-dc3c87031659 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032010 Aug 23 23:17:05.295647 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1565/3157] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:19:05.229862 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_api:SELECT=22 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.230994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG dbcounter [-] [121884] Writing DB stats nova_cell1:SELECT=46 {{(pid=121884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.234011 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 23:19:05.240991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.240991 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG dbcounter [-] [121885] Writing DB stats nova_cell1:SELECT=58 {{(pid=121885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.241258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:05.241258 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:05.243946 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:05.244381 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:05.244999 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:05.245591 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:05.246045 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:05.246472 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:05.277727 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Going to try to terminate instance {{(pid=121884) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:19:05.403055 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1937f812-8e5b-4c12-bf20-29981bf22a99", "tag": "ac7f80ee-1d0e-47cd-a979-27f787654922"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:19:05.414616 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:05.415103 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:05.415535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:05.430560 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] Creating event network-changed:ac7f80ee-1d0e-47cd-a979-27f787654922 for instance 1937f812-8e5b-4c12-bf20-29981bf22a99 on hv-cinder-84254 Aug 23 23:19:05.435916 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-c59cd2e0-ceda-4184-a2c7-ae378cf2e0cb req-307cad71-7b9e-42c7-a14e-3824b3fa0cdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206226 Aug 23 23:19:05.436596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1566/3158] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:19:05.602523 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a39901d4-4cf1-46ee-a0b3-b242c3ae7919 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 204 len: 0 microversion: 2.1 time: 0.374765 Aug 23 23:19:05.603515 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1593/3159] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:19:05 2022] DELETE /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:05.612400 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:05.613193 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:05.620476 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:05.621100 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:05.621625 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:05.622581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:05.623139 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:05.623658 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:05.825755 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:05.833871 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-f10ccb0c-9022-4343-a792-f98b509d0842 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1578 microversion: 2.1 time: 0.226116 Aug 23 23:19:05.834838 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1567/3160] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:05 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:06.856454 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:06.857188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:06.864506 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:06.864994 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:06.865450 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:06.866626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:06.866626 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:06.866988 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:07.072391 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:07.081141 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-23b4b9a7-9658-4b10-bbd5-d760bc148d3c tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1578 microversion: 2.1 time: 0.228832 Aug 23 23:19:07.082027 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1594/3161] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:06 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:08.073839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1937f812-8e5b-4c12-bf20-29981bf22a99", "name": "network-vif-deleted", "tag": "ac7f80ee-1d0e-47cd-a979-27f787654922"}]} {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:19:08.073839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:08.073839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:08.073839 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:08.083603 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.compute.server_external_events [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] Creating event network-vif-deleted:ac7f80ee-1d0e-47cd-a979-27f787654922 for instance 1937f812-8e5b-4c12-bf20-29981bf22a99 on hv-cinder-84254 Aug 23 23:19:08.091596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [req-65069182-9776-4d43-a04d-f67abf962c8e req-2d7b4669-cc1b-496e-9172-e11f7192430f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Aug 23 23:19:08.091596 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1568/3162] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:19:08.102202 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:08.102913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:08.109782 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:08.110288 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:08.110724 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:08.111464 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:08.111921 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:08.112347 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:08.179493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:08.188583 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-b8422f6e-844f-4354-b4ce-37fa94282af3 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1392 microversion: 2.1 time: 0.090331 Aug 23 23:19:08.189251 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1595/3163] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:08 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:09.208990 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] [27786243-2fe9-47b0-a0fe-b5f1c14d86c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59926. Aug 23 23:19:09.213958 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:09.215044 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:09.221557 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:09.222047 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:09.223156 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:09.224040 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:09.224522 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:09.224948 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:09.256971 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:09.257493 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:09.257933 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:09.258441 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.objects.instance [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lazy-loading 'fault' on Instance uuid 1937f812-8e5b-4c12-bf20-29981bf22a99 {{(pid=121885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:19:09.302375 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:09.310214 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-54907e49-a552-477a-84a8-8c975d1f6fbe tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 200 len: 1231 microversion: 2.1 time: 0.103344 Aug 23 23:19:09.310792 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1569/3164] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:09 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:10.332067 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:10.333159 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1937f812-8e5b-4c12-bf20-29981bf22a99] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:10.339410 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:10.339901 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:10.340369 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:10.341092 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:10.341550 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:10.341973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:10.356133 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] HTTP exception thrown: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Request method failure captured: Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 HTTP/1.1 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV5ZCfqYZhuFtUNbwiwJ3p_yflN0bPtF5Fea_CWH7Zdcicir6oxBnhbd-8bQcw8vmaB6hiNyUQWOX8BuwhuqkuC7phEwPVde__-DEZGLaj_S39FpXW9fR4cJEHcXPbrRW9UvQbzfmSHsCbAxV5LbwBT59JNeT8xw5mOCkOKgHqHG1pY Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:19:10.357818 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e5fdd0ced9b4bb3af81a136afaca202", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 51af1e82755e449993e110db493b689b Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. Aug 23 23:19:10.359349 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '1937f812-8e5b-4c12-bf20-29981bf22a99'} Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:19:10.360210 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. Aug 23 23:19:10.361432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:10.362492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Returning 404 to user: Instance 1937f812-8e5b-4c12-bf20-29981bf22a99 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:19:10.362492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-63fc72c8-b142-4fe8-a57c-6e118a04bd40 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99" status: 404 len: 111 microversion: 2.1 time: 0.031097 Aug 23 23:19:10.362492 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1596/3165] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:10 2022] GET /compute/v2.1/servers/1937f812-8e5b-4c12-bf20-29981bf22a99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:19:13.732881 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:13.733685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:13.735931 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d90043-3072-4c05-968e-7bb44f3d5fc6", "tag": "5779d37c-cd9a-40b3-bc52-191a91acdc09"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:19:13.741397 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:13.741894 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:13.742339 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:13.743437 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:13.744458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:13.744458 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:13.747628 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:13.748180 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:13.748861 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:13.762024 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] Creating event network-changed:5779d37c-cd9a-40b3-bc52-191a91acdc09 for instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 on hv-cinder-84254 Aug 23 23:19:13.767553 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-420bbf9f-c837-4440-9969-d95562329674 req-40776141-2ee4-4cbb-8886-87bf950e3b4c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035986 Aug 23 23:19:13.768585 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1597/3166] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:19:13.774436 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Going to try to terminate instance {{(pid=121885) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 23:19:14.013690 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-9475b118-2c0a-4f83-8290-4d72224e5642 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 204 len: 0 microversion: 2.1 time: 0.284346 Aug 23 23:19:14.014393 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1570/3167] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:19:13 2022] DELETE /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:14.025199 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:14.026432 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:14.033399 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:14.033972 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:14.034774 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:14.035722 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:14.036493 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:14.037298 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:14.180902 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:14.188700 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-460bcabd-e717-4068-ac6d-0325eca5ca3e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1577 microversion: 2.1 time: 0.168224 Aug 23 23:19:14.189312 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1598/3168] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:14 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:15.212410 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:15.213184 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:15.220287 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:15.220777 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:15.221336 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:15.222057 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:15.222581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:15.223351 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:15.365075 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:15.373110 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-e39b95a5-9a98-4140-96ef-5c1837c05508 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1458 microversion: 2.1 time: 0.165385 Aug 23 23:19:15.379288 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1571/3169] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:15 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1458 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:16.171055 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d90043-3072-4c05-968e-7bb44f3d5fc6", "name": "network-vif-deleted", "tag": "5779d37c-cd9a-40b3-bc52-191a91acdc09"}]} {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 23:19:16.182018 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:16.182498 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:16.182938 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:16.195086 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.compute.server_external_events [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] Creating event network-vif-deleted:5779d37c-cd9a-40b3-bc52-191a91acdc09 for instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 on hv-cinder-84254 Aug 23 23:19:16.199919 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [req-4c4247b2-a4d4-46f9-9b2d-063855050302 req-b7665c4e-25b2-4577-bc97-5b5e5a7e073d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Aug 23 23:19:16.200514 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1599/3170] 10.222.0.73 () {64 vars in 1317 bytes} [Tue Aug 23 23:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 23:19:16.395595 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:16.396168 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:16.402787 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:16.403278 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:16.403724 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:16.404421 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:16.404878 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:16.405464 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:16.472576 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.policy [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:16.481127 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-2a21e76c-a497-4df4-9492-92fea54fe4e5 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1225 microversion: 2.1 time: 0.090078 Aug 23 23:19:16.481733 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1572/3171] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:16 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:17.509546 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:17.510175 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:17.516909 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:17.521082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:17.521082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:17.521082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:17.521082 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:17.521483 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:17.557597 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:17.557737 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:17.558169 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:17.558612 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.objects.instance [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lazy-loading 'fault' on Instance uuid b5d90043-3072-4c05-968e-7bb44f3d5fc6 {{(pid=121884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 23:19:17.608075 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.policy [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af1e82755e449993e110db493b689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5fdd0ced9b4bb3af81a136afaca202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 23:19:17.615973 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-dd4d1608-3ec5-43c2-b2f4-f137f450721a tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 200 len: 1184 microversion: 2.1 time: 0.111563 Aug 23 23:19:17.616587 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1600/3172] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:17 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:18.637581 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:18.638227 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: b5d90043-3072-4c05-968e-7bb44f3d5fc6] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:18.645744 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:18.646245 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:18.646685 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:18.647409 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:18.647868 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:18.648294 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:18.666535 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] HTTP exception thrown: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Request method failure captured: Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 HTTP/1.1 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV5ZCfqYZhuFtUNbwiwJ3p_yflN0bPtF5Fea_CWH7Zdcicir6oxBnhbd-8bQcw8vmaB6hiNyUQWOX8BuwhuqkuC7phEwPVde__-DEZGLaj_S39FpXW9fR4cJEHcXPbrRW9UvQbzfmSHsCbAxV5LbwBT59JNeT8xw5mOCkOKgHqHG1pY Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:19:18.671645 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e5fdd0ced9b4bb3af81a136afaca202", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 51af1e82755e449993e110db493b689b Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. Aug 23 23:19:18.673316 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': 'b5d90043-3072-4c05-968e-7bb44f3d5fc6'} Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:19:18.674276 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. Aug 23 23:19:18.676527 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:18.678279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Returning 404 to user: Instance b5d90043-3072-4c05-968e-7bb44f3d5fc6 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:19:18.678279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-c0e55bbb-7b0e-4576-ae72-4bf58cfb2f5e tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6" status: 404 len: 111 microversion: 2.1 time: 0.036322 Aug 23 23:19:18.678279 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1573/3173] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:18 2022] GET /compute/v2.1/servers/b5d90043-3072-4c05-968e-7bb44f3d5fc6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:19:19.502370 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:19.503154 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.compute.api [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121884) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:19.510821 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:19.511315 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:19.511753 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:19.512458 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:19.512913 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:19.513374 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG oslo_concurrency.lockutils [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:19.528508 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.wsgi [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] HTTP exception thrown: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Request method failure captured: Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: request: DELETE /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 HTTP/1.1 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept: application/json Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Accept-Encoding: identity Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Connection: close Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Length: 0 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Content-Type: application/json Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Host: 10.222.0.73 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Openstack-System-Scope: None Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: User-Agent: python-urllib3/1.26.11 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Auth-Token: gAAAAABjBV5ZCfqYZhuFtUNbwiwJ3p_yflN0bPtF5Fea_CWH7Zdcicir6oxBnhbd-8bQcw8vmaB6hiNyUQWOX8BuwhuqkuC7phEwPVde__-DEZGLaj_S39FpXW9fR4cJEHcXPbrRW9UvQbzfmSHsCbAxV5LbwBT59JNeT8xw5mOCkOKgHqHG1pY Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Id: None Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Domain-Name: None Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Identity-Status: Confirmed Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Is-Admin-Project: True Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Id: default Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Domain-Name: Default Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Project-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Role: reader,member Aug 23 23:19:19.530255 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Roles: reader,member Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e5fdd0ced9b4bb3af81a136afaca202", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-Tenant-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Id: default Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Domain-Name: Default Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Id: 51af1e82755e449993e110db493b689b Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: X-User-Name: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: method: > Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: exception: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.531698 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: action_args: {'id': '1afb0b9d-ac31-476e-8994-feb610f6b831'} Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:19:19.532451 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.533614 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.535108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Returning 404 to user: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. {{(pid=121884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:19:19.535108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-a1b1aeda-b0e0-452a-9ee8-f79372933855 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 404 len: 111 microversion: 2.1 time: 0.033360 Aug 23 23:19:19.535108 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1601/3174] 10.222.0.73 () {58 vars in 1239 bytes} [Tue Aug 23 23:19:19 2022] DELETE /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 23:19:19.541257 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '>' {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:19.541861 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.compute.api [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [instance: 1afb0b9d-ac31-476e-8994-feb610f6b831] Fetching instance by UUID {{(pid=121885) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 23:19:19.548809 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:19.549680 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:19.550121 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:19.551366 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Acquiring lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 23:19:19.551713 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 23:19:19.552147 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG oslo_concurrency.lockutils [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Lock "50e9abbb-8f95-4d24-95a3-13ba3d95fa34" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 23:19:19.567275 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.wsgi [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] HTTP exception thrown: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Request method failure captured: Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: request: GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 HTTP/1.1 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept: application/json Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Accept-Encoding: identity Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Connection: close Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Length: 0 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Content-Type: application/json Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Host: 10.222.0.73 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Openstack-System-Scope: None Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: User-Agent: python-urllib3/1.26.11 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Auth-Token: gAAAAABjBV5ZCfqYZhuFtUNbwiwJ3p_yflN0bPtF5Fea_CWH7Zdcicir6oxBnhbd-8bQcw8vmaB6hiNyUQWOX8BuwhuqkuC7phEwPVde__-DEZGLaj_S39FpXW9fR4cJEHcXPbrRW9UvQbzfmSHsCbAxV5LbwBT59JNeT8xw5mOCkOKgHqHG1pY Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Id: None Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Domain-Name: None Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Identity-Status: Confirmed Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Is-Admin-Project: True Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Id: default Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Domain-Name: Default Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Project-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Role: reader,member Aug 23 23:19:19.568979 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Roles: reader,member Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e5fdd0ced9b4bb3af81a136afaca202"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e5fdd0ced9b4bb3af81a136afaca202", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}] Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Id: 9e5fdd0ced9b4bb3af81a136afaca202 Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-Tenant-Name: tempest-TestVolumeBootPattern-936931858 Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Id: default Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Domain-Name: Default Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Id: 51af1e82755e449993e110db493b689b Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: X-User-Name: tempest-TestVolumeBootPattern-936931858-project Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: method: > Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: exception: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.570494 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: action_args: {'id': '1afb0b9d-ac31-476e-8994-feb610f6b831'} Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: {{(pid=121885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 23:19:19.571313 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. Aug 23 23:19:19.572725 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: ERROR nova.api.openstack.wsgi Aug 23 23:19:19.574597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: DEBUG nova.api.openstack.wsgi [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Returning 404 to user: Instance 1afb0b9d-ac31-476e-8994-feb610f6b831 could not be found. {{(pid=121885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 23:19:19.574597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO nova.api.openstack.requestlog [None req-013e3508-ce17-4a35-a214-b53df0d681be tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831" status: 404 len: 111 microversion: 2.1 time: 0.033021 Aug 23 23:19:19.574597 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: [pid: 121885|app: 0|req: 1574/3175] 10.222.0.73 () {58 vars in 1236 bytes} [Tue Aug 23 23:19:19 2022] GET /compute/v2.1/servers/1afb0b9d-ac31-476e-8994-feb610f6b831 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 23:19:21.162311 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: DEBUG nova.api.openstack.wsgi [None req-4db31372-5dce-4cea-9abb-bbbf5fa74635 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] Calling method '.version_select at 0x7f5ed570ef70>' {{(pid=121884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 23:19:21.168516 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4db31372-5dce-4cea-9abb-bbbf5fa74635 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [71b464f7-f739-42b0-996e-df23f4e8f766] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 23:19:22.178577 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [None req-4db31372-5dce-4cea-9abb-bbbf5fa74635 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] [71b464f7-f739-42b0-996e-df23f4e8f766] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59986. Aug 23 23:19:22.282980 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO nova.api.openstack.requestlog [None req-4db31372-5dce-4cea-9abb-bbbf5fa74635 tempest-TestVolumeBootPattern-936931858 tempest-TestVolumeBootPattern-936931858-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1067012192" status: 202 len: 0 microversion: 2.1 time: 1.125920 Aug 23 23:19:22.283838 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: [pid: 121884|app: 0|req: 1602/3176] 10.222.0.73 () {58 vars in 1263 bytes} [Tue Aug 23 23:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1067012192 => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 23:19:35.445619 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:19:35.446166 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:19:37.130366 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:19:37.131386 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:20:18.160706 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:20:18.161381 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:21:28.309541 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:21:28.310244 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:21:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:21:55.126252 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:21:55.126752 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:21:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:22:55.454841 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:22:55.455487 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:22:57.139188 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:22:57.139664 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:23:38.170194 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:23:38.170806 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:24:33.290174 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:24:33.290788 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:24:48.318791 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:24:48.319395 dv-cinder-842542-4-iscsi devstack@n-api.service[121885]: Tue Aug 23 23:24:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 23:25:15.136013 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 23:25:15.136486 dv-cinder-842542-4-iscsi devstack@n-api.service[121884]: Tue Aug 23 23:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!